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I. INTRODUCTION 


А. GOALS 

There were two major goals of this thesis. The first goal was to develop a computer- 
vision method of automatcally identifying the sources for discrete low-frequency 
underwater sounds. These sounds are received by fixed hydrophones located off of the west 
coast of the United States. The sounds are digitized at 128 Hertz. The second goal was to 
develop computer-vision techniques for automatically correlating the shapes of these 
signals to closely spaced pairs of hydrophones that are hundreds of kilometers apart. 

Artificial-intelligence vision-processing techniques were used to achieve the first 
goal. Approximately 90% of large baleen whale moans are properly identified, nearly all t- 
phase signals from earthquakes are identified, and man-made calibration signals were also 
identified. The shape correlation goal was achieved through the use of an artificial- 
intelligence blackboard architecture and by computer-vision correlation of regions from 
two sets of distantly spaced hydrophones. A comparison of this method against the 
traditional correlation of signals using Fast Fourier Transforms shows this to be a valid 
technique. 

There were two motivations for this thesis. Current processing on the acoustic signals 
attempts to automatically detect the occurrence of t-phase signals. There are many false 
identifications of t-phase signals that are actually whale moans. This thesis addresses that 
problem. The other motivation for this thesis is that the knowledge about blue and fin whale 
migration patterns and stock assessments is very limited. This thesis demonstrates that 
acoustic tracking of large baleen whales is feasible. 

The techniques developed for this thesis can be used to build a system that will 
automatically track large baleen whales and to automatically detect and locate submarine 


seismic events. 


B. ORGANIZATION 


Chapter IJ of this thesis discusses background about noises that are produced 
underwater and how these noises can propagate for long distances. Chapter II also reviews 
the previous work that has been done with t-phase detection and correlation, and with large 
baleen whale identification. Chapter III discusses the methods used to identify discrete low- 
frequency underwater signals. Chapter IV discusses the methods used to correlate signals 
between nearby hydrophones as well as far-apart hydrophones. 

Chapter V gives a description of the computer program that was written to solve the 
identification problem. The identification program was written in the Prolog language. 
Chapter VI describes the computer program that was written to solve the correlation 
problem. The correlation program was written with the Common Lisp Object System 
(CLOS). Chapter VII is a discussion of the results of this research including the 
performance of the computer programs. Chapter VIII presents the conclusions of this 
thesis. Both achievements and weaknesses are discussed, as well as suggestions for further 


research. 


II. SURVEY OF PREVIOUS WORK 


A. INTRODUCTION 

The United States Navy has recently declassified many aspects of its undersea acoustic 
surveillance systems (Fox, 1993). These systems are now being used by geophysicists in 
the VENTS program, the sponsor of this work, to monitor undersea earthquakes and 
volcanoes. The undersea surveillance system also has great potential for use in tracking and 
estimating populations of marine mammals, including the largest baleen whales. This 
chapter discusses background concerning the use of the undersea surveillance systems. An 
overview of the current state of t-phase processing is then presented. A brief description of 
computer vision is also presented along with its relevance to the processing of digitally 
recorded hydrophones. The chapter ends with a discussion of the research on large baleen 


whale acoustics. 


B. BACKGROUND 

The National Oceanic and Atmospheric Administration (NOAA), Pacific Marine 
Environmental Laboratory (PMEL), Ocean Environment Research Division (OERD) is 
conducting an ongoing study of the impact that the dynamics of the geological processes 
occurring on the mid-ocean spreading ridges have on the Earth's oceans. Earthquakes and 
volcanism play a major part in these dynamic processes. This ongoing study is known as 
the VENTS program. 

The United States Navy has for many years had an undersea surveillance system that 
has been used for monitoring submarine activities (Fox, 1993). This system consists of both 
fixed and mobile hydrophone systems. The system of interest in this thesis is the SOund 
SUrveillance System (SOSUS). SOSUS consists of fixed arrays of hydrophones mounted 
at the approximate depth of the deep sound channel. These hydrophones are very sensitive 


and have the ability to pick up very low frequency sounds. 


When an earthquake occurs, there are three kinds of energy, or phases, associated with 
it. First, there 1s a primary phase known as a p-phase. This phase consists of energy that is 
transmitted as compressional shock waves within the earth's crust. The secondary or s- 
phase consists of transverse shock waves which are also transmitted through the earth's 
crust. The tertiary phase of an earthquake, or t-phase, is only associated with underwater 
earthquakes. The t-phase is acoustic energy which is transmitted into the water column 
from the shaking of the ocean floor. The definition of t-phase has been expanded to include 
any low-frequency seismic event which transmits acoustic energy into the water column 
(Hammond, 1990). T-phase signals which are received at remote hydrophones typically 
have a frequency range from just a few Hertz to just a few tens of Hertz (Hammond, 1990). 

There are two qualities of the physics of the ocean that allow us to study t-phases and 
other low-frequency acoustic phenomena at long ranges. One quality is that the attenuation 
of sound by seawater is very small for such low frequencies. The attenuation rate due to 


absorption in seawater varies with the square of the frequency. For a frequency of 100 Hz, 


the attenuation rate due to absorption is approximately 107° decibels per meter (Clay, 1977, 
pg. 100). The second quality is the deep sound channel which exists in all of the worlds 
oceans. This deep sound channel traps sound which enters it at a small enough angle and 
propagates it for very long ranges without the sound interacting with either the ocean floor 
or the ocean surface. This reduces the attenuation of sound due to spreading from a 
spherical relationship to a cylindrical relationship. 

The speed of sound increases with increasing pressure and it decreases with decreasing 
temperature. À greater water depth correlates with a greater pressure at that depth. Also, a 
greater water depth generally correlates with a colder water temperature until the 
temperature reaches a few degrees above freezing. The temperature of the water in the 
ocean at depth does vary, but minimally. There are many components to the sound speed 
equation for seawater, including salinity, but the factors of pressure and temperature are 
primarily responsible for creating a sound speed minimum at a moderate depth in the ocean. 


The depth of the sound-speed minimum varies depending on the qualities of the water 


column, but it is typically around 800 meters in mid-latitudes. Sound traveling in the water 
is refracted toward areas that have lower sound speeds. This sound speed minimum is the 


reason that the deep sound channel exists. 


C. T-PHASE PROCESSING 

One of the goals of this thesis was to develop a technique which would automatically 
identify t-phases. Loud whale moans are sometimes mistakenly identified as t-phases and 
some low-volume t-phases are not detected. A discussion of the t-phase processing follows. 

In 1991 the VENTS program installed a data collection system at a Navy facility to 
digitize and record data from the SOSUS hydrophones. NOAA/PMEL/OERD was given 
access to hydrophones from five hydrophone arrays scattered around the northeast Pacific 
ocean basin. Two hydrophones from each of five arrays, plus five directed beams, are being 
monitored continuously by the NOAA system. The hydrophone signals are digitized at a 
rate of 128 Hertz with 8 or 16 bit accuracy, depending on the hydrophone. The digitized 
hydrophone signals are recorded to 2.3-Gigabyte 8-mm tapes. Approximately one tape of 
data per week is collected (Fox, 1992). 

The collected data is analyzed by scientists at OERD using signal processing 
methodologies. Fast Fourier Transforms are run on the digitized recordings from each 
hydrophone to transform the data from its time vs. amplitude raw format to a time vs. 
frequency format. This time-frequency data is scrolled across a computer screen while a 
scientist visually looks for t-phases. The analysis software also has an automatic t-phase 
detector built in, but it has not proved trustworthy enough to allow the data tapes to be 
scanned entirely by machine. After t-phase events are identified, they are correlated 
between hydrophones on the same hydrophone array. This correlation gives a time 
difference between nearby hydrophones. From this information, and with the information 
provided by using an underwater sound propagation model, a tentative hyperbolic line of 


position can be determined. The line of position is tentative because the correlations are 


sometimes ambiguous. The best six correlations are saved in case the first correlation 
proves to be erroneous (Fox, 1992). 

A rough location can be determined by intersecting the hyperbolic lines of position on 
a seismic event from three or more hydrophone arrays. The position obtained by using time 
differences of the closely spaced hydrophones is not very accurate because of the errors that 
are induced by the proximity of the hydrophones combined with the digitization rate of the 
signal. Once a rough position is obtained, a more accurate position can be determined by 
time-correlating the t-phase receptions between the widely spaced hydrophones of the 


different arrays (Fox, 1992). 


D. COMPUTER VISION 


For the t-phase processing, when the time-frequency data from the hydrophones 15 
scrolled across the computer screen, the operator identifies the t-phases or other events of 
interest visually. T-phases have shapes which are easily distinguished by a human operator 
looking at the time-frequency plot. There are also whale moans in this data, and they have 
easily distinguishable shapes that are visually distinct from the t-phases. The signal 
processing techniques that are used in the analysis of these sounds are not designed to 
distinguish between the shapes of whale moans and the shapes of t-phases. The automatic 
detector that is in use is amplitude based, and it sometimes provides false detections due to 
whale moans or other noises (Fox, 1992). 

Vision processing techniques are well suited for the t-phase problem. Time-frequency 
plots of the hydrophone data are digitized pictures. The t-phases in these plots are easily 
recognized by a human operator. They have simple parameters and can also be easily 
recognized by vision processing techniques. The whale moans are more complex, but they 
are also easily identified by a human operator. The parameters of whale moans are also 
more difficult to identify, but most whale moans can be recognized by vision processing 


techniques. A short discussion of computer vision processing follows. 


Computer vision is the sub-field of artificial intelligence that is concerned with 
emulating human visual perception. The basic problem of computer vision is to identify the 
shapes that are in a digitized picture (Charniak, 1985, pg. 89). Vision processing is broken 
up into two distinct parts. Low-level processing is performed on the entire picture in order 
to gain information from the raw image and classify it for later processing. The results of 
this low-level processing is typically a set of edges, corners, and regions. The high-level 
processing uses the knowledge gained by the low-level processing to perform a cognitive 
analysis of the picture (Ballard, 1982, pg. 6). Usually, this high-level processing uses 
mathematical descriptions of typical shapes as its knowledge domain in order to identify 
the shapes in the picture (Charniak, 1985, pg. 150). 

Low-level vision processing 1s centered around the concept of connected pixels. If a 
picture is made up of pixels that are either turned on or turned off, then strongly connected 
pixels are pixels that are turned on and are adjacent to each other, either vertically or 
horizontally. Weakly connected pixels are pixels that are turned on and have an adjacent 
corner. Disconnected pixels are those pixels that are turned on and are neither strongly nor 
weakly connected (Dougherty, 1992). 

This thesis directly uses some vision processing programs by Professor Neil C. Rowe 
of the Naval Postgraduate School. These programs perform the low-level vision processing 
needed to create a black-and-white image from a multi-spectral image and they also 


identify regions for further processing. 


E. WHALE RESEARCH 


During the course of the research for a thesis on t-phase detection and correlation, it 
became apparent to us that there might be some benefit from this thesis to the community 
of whale researchers. There are many sounds on the data tapes that we examined that are 
from some large species of whale. If the species of whale can be determined, and if an 


average rate of moaning can be determined, then the techniques presented in this thesis can 


be used to help determine stock assessments, locations, and migration patterns of these 
whales. 

The whale moans that occur repeatedly in this data are not a known call from any 
species of whale (McDonald, 1993). There has been speculation that these moans come 
from either blue whales (Balaenoptera musculus) or fin whales (Balaenoptera physalus) 
(Fox, 1993b). These two species of whale are the largest living species of animals 
(Mizroch, 1984a; Mizroch, 1984b), and both species have been previously associated with 
low-frequency moans, although these moans have had different shape and duration (Bird, 
1987; Cummings 1971; Cummings, 1986). The inability of researchers to associate the 
moans that are seen in the t-phase data with a particular species indicates the inherently 
difficult nature of studying large whales that live in the open ocean. 

Both fin whales and blue whales are either solitary or are found in small groups and 
both species also migrate north-south over vast stretches of ocean each year (Mizroch, 
1984a; Mizroch, 1984b). The stock assessment of each of these species of whale 1s very 
rough due to the difficulties of counting solitary animals in the open ocean (Mizroch, 
1984a; Mizroch, 1984b). As of 1984, the stock estimates of the blue whale in the north 
Pacific indicate that it has not made any recovery from the time that the killing of blue 


whales by man ceased in 1965 (Mizroch, 1984a). 


III. IDENTIFICATION OF DISCRETE SIGNALS 


A. INTRODUCTION 

The objective of the signal identification part of this thesis was to identify whale moans 
and t-phase signals. Complicating this objective is the environment within which the 
hydrophones exist. On the data segments that we analyzed, there were some time periods 
that were extremely noisy, and also some time periods where the hydrophone signal was 
replaced with a calibration signal. There was some noise present for the entire data set. This 


chapter discusses the methodology used to identify regions from a noisy data set. 


B. AUTOMATIC IDENTIFICATION OF ACOUSTIC SIGNALS 


Previous efforts to automatically identify t-phase signals have been unreliable because 
they have been based on the amplitude of the incoming signal in a selected frequency band. 
Anything that makes a loud enough noise in the same band will be detected as a t-phase. 
Also, any earthquake that does not make a loud enough noise will not be detected as a t- 
phase. An amplitude detector is the best method to use with traditional signal processing 
methods, even with the limitations, due to the nature of these methods. 

We have taken a different approach to automatically identifying t-phase signals. This 
approach also has the side-benefit of identifying most other signals that are received on the 
hydrophone. By looking at the time-frequency plot of the hydrophone data as a picture, we 
use computer-vision processing methods to identify the signals that are digitized from the 
hydrophone. This emulates the process of a human operator looking at the data and 
identifying signals of interest. 

Figure 1 shows a time-voltage plot of some sounds received by a hydrophone and the 
transform of that signal into the time-frequency domain. Figure 1(a) is a plot of the raw 
signal voltages over time. There is one minute of signal reception plotted, or 7680 points 
of raw data. Figure 1 (b), (c), and (d) show this same signal after it has been Fourier 


transformed into the time-frequency domain. Transforms were performed on each second 


of data, giving a one second resolution in the time scale and a one Hertz resolution in the 
frequency scale. Only one side of the symmetric spectrum from 0 to 64 Hertz are shown. 
The black pixels in Figure 1(b) are all of the pixels in the Fourier transform that had a 
magnitude greater than 15. In Figure l(c), the black pixels are those with a magnitude 
greater than 30. In Figure 1(d), the black pixels are those with a magnitude greater than 45. 
Each element of a Fourier transform array represents a magnitude of sound over a range of 
frequencies. For these Fourier transform arrays, each element of each Fourier transform 
аттау represents the magnitude of the sound intensity received for one second over a range 


of one Hertz. 
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Figure 1: Time-voltage and time-frequency plots of a signal. 


The geophysicists that are monitoring the hydrophone signals for t-phases are not 
burdened with the problem of representing magnitudes in black and white. The processing 
Is being done on color graphics workstations. Magnitudes are represented by an array of 
colors. The analyst working with the data can immediately see the intensity of the sound 
over various frequencies by the color-coded output. 

T-phases, whale moans, and other identifiable signals have distinct shapes that can be 
recognized by both a human and a computer. In order for a computer to recognize a signal, 
the signal must first go through some low-level vision-processing which will take the time- 


frequency data and find cohesive regions while eliminating a majority of the noise. We 


have developed a ten-step low-level processing strategy that takes a set of Fast Fourier 
Transform magnitudes, arranged by time and frequency, and creates a set of well-defined 
regions that can be identified by number. 

Our low-level vision processing creates, in essence, a black and white (or on and off) 
pixel image from the Fast Fourier Transform magnitudes. Noise is removed from this 
image and then regions have gaps filled in. Man-made pixels are then marked and removed. 
Man-made regions come from such things as boat noises and calibration signals. Once all 
of this is done, regions are clumped together. The final low-level step is to associate the 
turned-on pixels with the magnitudes that existed in the original data. Chapter V, Section 
D provides details on these steps. 

Once the low-level processing is completed, high-level vision processing performs the 
feature extraction from the identified regions. This high-level processing groups nearby 
regions together into larger logical regions and determines whether they are t-phase signals, 
whale moans, or of unknown origin. This is done in a twelve-step process which is 


described in detail in Chapter V, Section E. 


C. CHARACTERISTICS OF SIGNALS 

The calibration signal, which is removed in the low-level processing, always has the 
pixels at 27 and 28 Hertz turned on. It also always has the pixels between the frequencies 
of 3 and 24 Hertz turned off and the pixels between the frequencies of 30 and 34 Hertz 
turned off. Other pixels may or may not be turned on, but this description is adequate for 
uniquely describing the calibration signal. 

Figure 2 shows a typical calibration signal. In the first minute of this plot, there is a 
whale signal and some random noise. The calibration signal runs for approximately two 
minutes. During that two minutes, the reception of the hydrophone signal is cut off. After 
the calibration signal stops at about the third minute in the plot, the hydrophone signal 
becomes extremely noisy. For this figure all Fourier transform magnitudes that were 


greater than 45 were plotted. 
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Figure 2: Time-frequency plot of a calibration signal. 


Through an examination of the Fourier transformed sounds, we found that whale 
moans meet the following minimum criteria: a minimum frequency greater than 20 Hz, a 
time span between 12 and 60 seconds, an area between 50 and 500 pixels, and a density 
between 8 and 75%. This very general set of criteria has been determined to be good enough 
to identify a majority of the whale signals without being so general as to mistakenly identify 
other signals as whales. 

Figure 3 shows eight complete whale moans in the center of the time-frequency graphs 
and parts of two more whale moans at the beginning and ending times in the graph. The 
shapes are easily identifiable because human visual processing can fill in disconnected 
regions. Each of the whale moans has several properties in common, but each moan is also 
a distinctly different sound. For this figure, all Fourier transform magnitudes that were 


greater than 35 were plotted. 


l'ouier transform of sume whale nans 


Е <ососло-«- 


~ 





2 Тілме (ain) 


Figure 3: Time-frequency plot of several whale moans. 


Every t-phase signal that we have observed has a minimum frequency of less than 10 
Hertz. Many t-phase signals have the additional characteristic that their maximum 
frequency was less than 20 Hertz. These were subdivided into a class called far-field t- 
phases since the higher frequencies were probably frequency attenuated. 

Figure 4 shows a t-phase signal in addition to whale moans. The t-phase begins at 
about the half minute point in the plot and slowly dies out by the fourth minute. There are 
also 10 complete and two partial whale moans during this time. For this figure, all Fourier 


transform magnitudes that were greater than 35 were plotted. 
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Figure 4: Time-frequency plot of a t-phase signal. 
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All pixel regions which did not meet any of these criteria, were classified as 
unidentified signals. Some of these unidentified signals were actually whale moans, but 
many of them were just unidentifiable noisy signals. 

Figure 5 shows a particularly noisy time period. There are no discernible shapes in this 
signal. The cause of this noise could possibly be a defective link between the hydrophone 
and the data collection equipment. We speculate that this is the cause because the 
calibration signal shows up frequently around the noisy areas of the signal. Extremely noisy 
periods also occur when there is vessel traffic very near the hydrophones. For this figure, 
only Fourier transform magnitudes that were greater than 130 were plotted. Nearly every 


pixel in this graph has a magnitude greater than 45. 
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Figure 5: Time-frequency plot of a noisy signal. 
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IV. CORRELATION OF SIGNALS 


A. INTRODUCTION 

When an underwater sound is correlated between two hydrophones, the relative time- 
shift between the receptions of that sound can be determined. Once the time difference of 
a signal reception is known, a hyperbolic line-of-position can be found. Deterministic 
models exist for calculating lines-of-position, given the transmission qualities of the 
medium, the geometry of the hydrophone placements, and the time difference of the signal 
reception (Loje, 1983). 

Four hydrophone recordings were studied for this thesis. The hydrophones are in a 
geometry of two pairs of hydrophones that are far apart. The hydrophones in each pair are 
approximately 400 meters apart and the pairs of hydrophones are approximately 340 
kilometers apart (Dziak, 1993). Assuming a sound speed of 1500 meters per second in the 
deep sound channel, the travel time for sound between the nearby hydrophones is about a 
third of a second, and the travel time for sound between the far-apart hydrophones is nearly 
4 minutes. 

The objective of the signal correlation part of this thesis was to correlate identified 
sounds between the nearby hydrophones and then to correlate these nearby-correlated 
signals between the far-apart pairs of hydrophones. There are two different problems 
presented when attempting to correlate a signal between the nearby hydrophones and 
between the far-apart hydrophones. When correlating a signal between nearby 
hydrophones the time difference is short, but the differences in hydrophone characteristics, 
the near-field effects of the environment, and the effects of region growing in the signal 
identification program will make the signals look different. When correlating a signal 
between far apart hydrophones, attenuation and time stretching will have additional effects 
on the signal shape (Urick, 1975). There are also many more possible signals from which 


to choose for a correlation. 
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В. NEAR-FIELD CORRELATIONS 


The geophysicists that are monitoring the SOSUS hydrophones find the time- 
differences between the arrivals of signals at nearby hydrophones by using Fast Fourier 
Transform correlation techniques. The purpose of this nearby hydrophone sound 
correlation is to determine tentative a tentative bearing to the source of a signal. The 
preliminary bearings are calculated in order to reduce the number of calculations that are 
needed to correlate signals to the far-apart hydrophones. “The results are often ambiguous 
and a selection of six possible azimuths (and back-azimuths) are recorded” (Fox, 1992). 

The purpose of correlating signals to the nearby hydrophones in this thesis was to 
determine possible candidates for correlation to the far-apart hydrophones. Finding 
tentative bearings from the time offsets was not possible using our approach because of the 
resolution of the shapes created in the identification program was too rough relative to the 
travel time of sound between the nearby hydrophones. The research in this part of the thesis 
concentrated primarily on the whale moans. The whale moans are much more frequent than 
the t-phase signals and thus present a better opportunity to apply artificial-intelligence 
techniques to their correlation. 

An artificial-intelligence computing model known as the blackboard architecture was 
applied to the problem of correlating signals to nearby hydrophones. The blackboard 
architecture was appropriate for this application because there is a hierarchy of states to 
which the regions can belong, and there are independent knowledge sources that can 
change the state of the blackboard based on the facts which have been posted to the 
blackboard. 

The framework for a blackboard consists of three elements: the blackboard, multiple 
knowledge sources, and a controller. The blackboard consists of facts that are arranged in 
a hierarchical structure. The knowledge sources act independently on the facts contained in 
the blackboard and can add new facts and retract old facts. The controller determines when 


a knowledge source should be invoked (Nu, 1986). 
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The structure of the blackboard for matching the nearby hydrophones consisted of: 
unmatched regions, tentatively matched regions, definitely matched regions, and 
unmatchable regions. The characteristics of each hydrophone were also a part of the 
blackboard structure, along with the times associated with the matched regions. 

The knowledge sources for the correlation program were: current-time, time-span, 
time-separation, best-match, unmatchable-signal, and multiple-match. Each of these 
knowledge sources contributed information to the blackboard, and when new knowledge 
was added to the blackboard, the knowledge sources were able to act on it. Some 
knowledge sources are more complex than others. The current-time knowledge source just 
adds the start time of the most recently read region to the blackboard while the 
unmatchable-signal knowledge source tests the current time against the start times of all of 
the regions in the unmatched-region list and moves regions to the unmatchable-region list 
based on the maximum possible travel time between the hydrophones. 

The controller got a new region for a hydrophone and implemented the appropriate 
knowledge sources. The new region would either be added to the unmatched-region list or 
the tentatively-matched-region list. Once this was done, other knowledge sources would be 
called on to move unmatched regions to the unmatchable-region list and to move 
tentatively-matched regions to the definite-matched-region list. 

signals were matched by time shifting one signal so that its starting time matched the 
start time of the other signal. Then the number of pixels that the regions had in common 
was found. Doubling the number of overlapping pixels and dividing this by the sum of the 
pixels in both regions produced a number between 0 and | that represented a goodness-of- 
fit for the two signals. Each signal was time-shifted five times to cover a time period of two 
seconds on either side of the starting times of the signals. The maximum goodness-of-fit 
was taken from each of these time shifts. Multiple time shifts were needed because 


distortions of these signals during their transformations into shapes. 
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C. FAR-FIELD CORRELATIONS 


The geophysicists that are monitoring the SOSUS hydrophones find tentative bearings 
from the nearby hydrophones and use these bearings to search the data of the far-apart 
hydrophones for possible correlations of events. This can sometimes result in signals being 
incorrectly matched and it can also result in signals not being matched at all when they 
should be matched. 

We took a different approach in this thesis. We narrowed down the total number of 
regions that could be matched by the approximate direct-line travel time of sound from one 
hydrophone pair to the other. In this case, the total travel time was approximately 250 
seconds which includes an error factor for not knowing the transmission characteristics of 
the water column. For any particular sound received on one hydrophone pair, without a- 
priori knowledge about which direction that sound was coming from, there is a window of 
approximately 500 seconds of sounds to check against from the other hydrophone pair. For 
the whale moans in the data set that we examined, there were usually 15 to 20 moans that 
needed to be tested from one hydrophone pair for each moan recorded on the other pair. 

Even though time stretching and attenuation affect a signal traveling over such a long 
distance, we found that using the same time-shift and overlap technique that was applied to 
the correlation of signals to the nearby hydrophones was sufficient to match signals 
between far-apart hydrophones. The region from each nearby hydrophone pair that had the 
largest area was used for the correlation. We chose to use the region with the largest area 
for matching because it gave better results than using the smallest region. The larger 
regions tended to have higher correlations with regions from the far-apart hydrophones. 

Each pair of regions from the nearby hydrophones were matched to all possible pairs 
of regions from the far-apart hydrophones. The matchings were put into a list in decreasing 
order according to their goodness-of-fit. À time-shift transform was then performed on the 
best three matches for all of the regions. 

We developed the time-shift transform from an inspiration given to us by the Hough 


transform. The Hough transform is a vision processing technique which is typically used 
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for finding lines and curves in an image. One of its best advantages 1s that gaps in lines and 
a noisy image have little effect on the results of the transform (Ballard, 1982, p. 123). We 
were not looking for lines, but trends in the time delays that were exhibited by the matches 
of the signals. Finding trends in the time delays, in an image where there are several very 
close goodness-of-fit values for time delays, 1s analogous to finding lines in a noisy image. 
We divided up the total possible time-delay for correlation of signals between the far-apart 
hydrophones into bins that covered approximately 25 seconds each. This gave us 20 bins 
for the time-delay that we worked with on this data set. We chose this number because 25 
seconds was a typical length for a whale moan. For each region, the goodness-of-fit value 
for each of the top three matching regions was added to the appropriate time-delay bin. 
Each bin was then normalized to 0 by subtracting the smallest bin value from all of the bins. 
An omnidirectional noise level would show up as the same value in each of the bins in the 
time shift array. The normalization to 0 effectively eliminated these noise values. 

After normalization to 0, each bin was replaced with its square root. The square root 
was applied because each bin is made up of the goodness-of-fit values from both sets of 
hydrophones. A large set of strongly correlated signals would overshadow a smaller set of 
correlated signals because of the contributions of both sets of hydrophones to the time-shift 
array. If each bin were divided by two, there would be no net overall effect, but by taking 
the square root, a dampening effect is applied to the strongly correlated values. 

After each bin was replaced by its square root, each bin was normalized to | by 
dividing it by the maximum bin value. The result was a time-shift array with values in the 
range from 0 to 1. This time-shift array represented the relative frequencies of time delays 
for the correlations. 

Once the time-shift array was determined, the goodness-of-fit value for each match 
between the far-apart hydrophones was multiplied by the appropriate value from the time- 
shift array. This application of the time-shift array to the best-fit values decreased the 
likelihood that a goodness-of-fit value, for a time delay that had little evidence to support 


it, would dominate a similar goodness-of-fit value, for a time delay that had a lot of 
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evidence to support it. All far-apart matches were then rearranged according to the new set 
of goodness-of-fit values. 

After the application of the time-shift array, each pair of regions from one pair of 
nearby hydrophones had its best fit matched against the best-fit regions from the far-apart 
pair of hydrophones. The best fit of a pair of nearby hydrophones was a pair of nearby 
regions from the far-apart hydrophones. If the best fit of the far-apart pair of regions was 
the original set of regions, then those two sets of regions were classified as being correlated. 
After finding the best fits, each of the matched regions was removed from the list of 
possible matches and a second set of best fits was correlated. Two passes of the data set 


were sufficient to correlate nearly all of the far-apart regions. 
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V. IDENTIFICATION PROGRAM 


A. INTRODUCTION 
The identification program identifies whale moans, t-phase signals, and calibration 
signals. This chapter describes the identification program in detail, including the program 


input and output, program structure, and detailed descriptions of each program component. 


B. GENERAL DESCRIPTION 

The identification program was written in Prolog. Prolog is a language that is 
extensively used in artificial-intelligence applications. Some attractive features of Prolog 
are its logic-like syntax, its ability to backtrack through previous steps, and its 
multidirectional reasoning (Rowe, 1988, p. xiv). It was chosen as the language for the first 
part of this thesis primarily for these reasons. It was also chosen because Professor Rowe 
had a library of computer-vision software, written in Prolog, that could be used as a 
foundation for the thesis research. One of the characteristics of Prolog programs, including 
the program written for this thesis, is that there is no main program as in a traditional 
programming language. The program is made up of many short programs, usually just a 
few lines long. 

The identification program, diagramed in Figure 6, is approximately 1150 lines long, 
including the Prolog code and comments. I wrote approximately 750 lines and Professor 
Rowe wrote the other 450 lines. There is an additional library of vision processing 
programs that were written entirely by Professor Rowe. Some parts of this library are called 
on extensively by the programs in this thesis. This library contains approximately 750 lines 
of Prolog code. 

The identification program (see Appendix C) starts with a listing of the Fast Fourier 
Transform (FFT) magnitudes which have been computed from the raw time-voltage data 


using a C program. The FFT magnitudes are in a time-frequency order. Each line contains 
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the magnitudes for one second of time and each of the 64 magnitudes on a line correspond 
to one Hertz of frequency in ascending order. 

The primary purpose of the identification program is to take the FFT magnitudes, 
create a digital black-and-white picture from them, and identify the different shapes that 
appear in the picture. The program goes through two phases of computer-vision processing 
in order to achieve a result. The low-level processing works with the pixels of the entire 
picture to develop regions. The high-level processing performs feature extraction using the 
individual regions and classifies regions and groups of regions. 

There are two sets of output from the identification program. The first set of output is 
a file which contains a list of the grouped regions, the parameters of these groups, and 
horizontal and vertical lines that have been found in the picture. The first set of output also 
contains a listing of the classifications of all of the groups of regions. These classifications 
are: whale, near-field t-phase, far-field t-phase, and unknown. The parameters of the groups 
are: minimum and maximum frequency, start and stop time, area, density, and average 
intensity. These parameters were chosen because they provide a good overall description 
of the region. The average intensity is defined as the sum of all of the magnitudes of the 
Fourier transform for each pixel in the group divided by the area of the group. The density 
is the pixel density in the bounding box delineated by the minimums and maximums of 
frequency and time. In addition to the previous items, the first set of output also contains 
an orientation for each unknown group of regions. À straight line is fit to the pixels in each 
unknown group in a least-squares manner and the orientation of that line is listed. 

The second set of output is a list of pixels from each of the identified groups. This 
second set of output is written in such a manner as to be easily readable by the correlation 
program. Each group of regions is a list enclosed in parentheses with a letter code indicating 


the identification of the region as the first element of that list. 
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C. BLOCK DIAGRAMS 
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Figure 6: Top Level Diagram of Identification Program 


23 


LOW-LEVEL PROCESSING 


TIME-FREQUENCY 
DATA 


DEVELOP BINARY MAP 


REMOVE LONE PIXELS 


GROW REGIONS ASSOCIATE PIXELS 


REPLACE PICTURE 


FIND MAN-MADE SIGNALS WITH REGIONS 


На (КЕРЕАТ ОМСЕ) 


MAN-MADE SIGNALS 


ADD PIXEL MAGNITUDES 
TO REGIONS 


х; 
Se 
= 
О 
< 
tri 


PIXEL FACTS WITH 
TIME, FREQUENCY, 


REGION NUMBER AND 
MAGNITUDE 





Figure 7: Diagram of Low-Level Vision Processing. 
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Figure 8: Diagram of High-Level Vision Processing. 
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D. LOW-LEVEL VISION PROCESSING COMPONENTS 


The low-level processing is the first major section of the identification program. It 
consists of 10 steps which will take as input the time-frequency data and turn it into a set 
of identified cohesive regions. 

When a Fast Fourier Transform (FFT) 15 run on the original time-amplitude data, it 
produces a set of data that is three dimensional in nature. For each time and frequency point, 
there is a number that represents the strength of the signal at that point. For the data set that 
was provided for this project, the original data was collected at 128 Hz. FFTs were run on 
every 128 points to geta 1 second time resolution anda | Hz frequency resolution. The FFT 
returns a frequency array of 128 points, but only 64 points are saved due to the symmetry 
of the spectrum (Press, 1988, pg. 403). 

The first step in the low-level processing takes the time-frequency data and develops 
a binary map of pixel data that is based on a moving threshold value. The objective of the 
first step is to develop a black and white image that has enough pixels turned on so that 
shapes can be determined, but not so many pixels turned on so that multiple shapes become 
merged. Frequency values that were above the threshold level caused the corresponding 
pixel to be turned on and frequency values that were below the threshold level caused the 
corresponding pixel to be turned off. We experimentally determined that the threshold 
should be adjusted to keep the number of turned-on pixels between 15% and 25% of the 
number of pixels in the frequency range for one second. These values allowed the following 
steps to create a set of cohesive identifiable regions. Upper and lower limits were set on the 
moving threshold value so that extremely noisy periods and extremely quiet periods would 
be represented. Figure 9(a) shows some whale moans that are the result of the first step. The 
programs for creating a binary map of pixel data based on a fixed threshold were written 
by Professor Rowe and modified by the author for the moving threshold value. 

The second Step in the low-level processing takes the black and white pixel image that 
is the result of step one and turns off all pixels that are turned on and are not strongly 


connected. This step removes much of the spurious noise in the image. Figure 9(b) shows 
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the result of the second step. The program for performing the second step was written by 
Professor Rowe. The third step in the low-level processing performs region growing by 
turning on pixels in order to fill in gaps across rows, columns, and diagonals. Figure 9(c) 
shows the result of the third step. The effect of this region growing step 1s to make fuller 
shapes. 

The fourth step and sixth step are the same, as are the fifth and seventh steps in the low- 
level processing. In the fourth and sixth steps, pixels which are probably noise or are man- 
made are marked with special symbols so that they can be removed in the next step. 
Presumed man-made pixels are those turned-on pixels that create a narrow frequency band 
for 2 or more seconds. Also fitting this category is the calibration signal, which has a 
distinctive set of frequencies. Pixels that are considered to be noise are those turned-on 
pixels that are not strongly connected in frequency, regardless as to whether they are 
strongly connected in time. The fifth and seventh steps in the low level processing simply 
remove all of the specially marked symbols from the previous steps. The result of these four 
steps is a black and white picture that has its major features sharpened and most of the noise 
surrounding these features removed. Figure 10 shows the results of these steps. The 
diagonal lines with a positive slope indicate pixels that were identified as man-made and 
the diagonal lines with a negative slope indicate pixels that were identified as calibration 
signals. 

The eighth step in the low-level processing performs region clumping by taking the 
black and white picture and associating a region number with each pixel. All pixels that are 
either weakly connected or strongly connected are associated with the same region. The 
result of this clumping is a picture that has numbers in the place of all of the previously 
turned on pixels. The programs for performing the eighth step were written by Professor 
Rowe. 

The ninth step in the low-level processing removes the concept of a picture that has 
pixels that are turned on or off and replaces this with the concept of a set of regions that 


have time and frequency values associated with them. The programs for performing the 
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ninth step were written by Professor Rowe. The tenth, and final, step in the low-level 
processing goes back to the original data file and associates the strength of the signal at each 
turned-on pixel with the time-frequency values for each region. 

There is no longer an image for the vision processing methods to work with. Instead, 
there is a set of well defined regions that have time, frequency, and strength values 
associated with them. In low-level vision processing, each element of a picture is processed 
in the same way (Charniak, 1985, pg. 95). Even though some of the follow-on processing 
will process each element of each region in the same way, there aren't any turned-off pixels 
to process, so all of the following processing is considered to be high-level vision 


processing. 
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Figure 9: Results of the First Three Steps of Low-Level Processing. 
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Figure 10: Results of Low-Level Processing Steps Four To Seven 
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E. HIGH-LEVEL VISION PROCESSING COMPONENTS 

The first step in the high-level processing finds the area, circumference, length, and 
width of each region. The area of a region 15 the total number of pixels in that region. The 
circumference of a region 1s the number of pixels in that region that are not strongly 
connected to four other pixels. The length of a region corresponds to the total amount of 
time that a sound occurs, and the width of a region corresponds to the total bandwidth of a 
signal. 

The second step in the high-level processing is a computational convenience. It was 
found that by specially noting the circumference pixels, that the process of grouping 
regions was much faster. This step finds each pixel in each region that is a circumference 
pixel and asserts it as an outer pixel. 

The third step finds nearby regions and groups them. If the square of the distance 
between any two outer pixels of two regions is less than 13, then the two regions were 
placed in the same group. The distance between pixels is related to their time-frequency 
value. The number 13 was derived experimentally. 

The fourth step characterizes the groups. For each group, the start and stop times are 
determined and the minimum and maximum frequencies are determined. Each group also 
has its total area (total number of pixels) determined along with its density and average 
intensity. Density was defined as total area, which is determined by the bounding box, 
divided by the group area, which is a count of the number of pixels in the group. The 
average intensity was determined from the intensity values that were associated with each 
pixel in the last step of the lower-level processing. 

The fifth step of the high-level processing finds horizontal lines. Horizontal lines are a 
collection of pixels that are outer-pixels of regions and extend over a significant period of 
time without changing in frequency. These lines could indicate the presence of a man-made 
signal that was not removed in the low-level processing. The sixth step is similar to the fifth 
step except that it finds vertical lines. These are lines that cover many frequencies at one 


time. The vertical lines could also be an indicator for a man-made signal such as an 
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underwater explosion. The seventh step in the high-level processing finds vertices from the 
intersections of the vertical and horizontal lines. These three steps are most often performed 
as low-level vision processing functions (Ballard, 1982, pg. 119), but we felt that it was 
more appropriate to perform these steps in the high-level processing so that region 
identifications could be associated with these features. 

The eighth step is a first pass at finding whale signals. The criteria for a group to be 
called a whale on the first pass is that it has: a minimum frequency greater than 20 Hz, a 
time span between 12 and 60 seconds, an area between 50 and 500 pixels, and a density 
between 8 and 75%. 

The ninth step in the high-level processing is finding t-phase signals. First, all potential 
t-phases are found with the simple criteria that they have an area greater than 5 pixels and 
a minimum frequency that is less than 10 Hz. T-phases are then divided into far-field and 
near-field earthquakes. Far-field earthquakes are considered to be those that have a 
maximum frequency of less than 25 Hz. See Chapter II for a discussion of frequency 
attenuation. Far-field earthquakes also have the tendency to have many disconnected 
groups of regions. If any two groups of regions are determined to be far-field earthquakes 
and they are separated by a time period of less than 9 seconds, then they are determined to 
be a part of the same earthquake. The near-field earthquakes are all earthquakes that are not 
far-field earthquakes. 

The tenth step in the high-level processing is to place all of the remaining groups of 
regions that have an area greater than seven into a category called "unknown groups". For 
each of these unknown groups, further determinations are made about their shapes. А 
straight line is least-squares fit through the pixels of the group and the angle of that line in 
the frequency-time plane is determined. With this line established, the mean distance of the 
pixels from the line is determined, along with the variance. 

The eleventh step in the high-level processing is to check each unknown group to see 
if it might be part of a whale moan. The previous processing was not including many of the 


upper frequency sounds of the whale moans because the regions of the higher frequency 
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sounds were separated by too many turned-off pixels from the regions making up the 
whale-moan group. If the maximum frequency of a whale moan is within 8 Hertz of the 
minimum frequency of an unknown group and if the ending time of a whale moan is within 
14 seconds of the starting time of an unknown group, then the unknown group is removed 
from the list of unknown groups and a combined whale group is created. 

The twelfth and final step in the high-level vision processing is writing the results to 
files. An explanation of the output is given in the general program description section of 


this chapter. 


F. ABANDONED ALGORITHMS 

The whale moans could be classified using other types of parameters. Another 
parameter that can help to define a whale moan is the typical angle that a line would make 
if it were passed through the signal using a least squares fit. This would describe the 
tendency of the whale moan to upsweep in time through a frequency band of about 40 
Hertz. This line-fitting approach was tried at one point in the investigation, but it was found 
to be too time consuming. 

The calibration signal was originally left for high-level processing. It was found that 
frequent small gaps in the signal and variations in the upper frequency ranges of the signal, 
combined with abutting regions from other sources at the beginning and end of the 
calibration signal, caused it to be very difficult to identify during the high level processing, 
but the low-level processing identifies the calibration signal very easily on a line by line 


basis. 
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VI. CORRELATION PROGRAM 


A. INTRODUCTION 


The correlation program has two goals. The first 1s to correlate signals between nearby 
hydrophones. The second is to correlate the nearby-correlated signals to far-apart 
hydrophones. Different techniques were used for each type of correlation. This chapter 
describes the correlation program in detail, including the program input and output, 


program structure, data structures, and detailed descriptions of each program component. 


B. GENERAL DESCRIPTION 

The correlation program (see Appendix D) was written in the Common Lisp Object 
System (CLOS). CLOS is an object-oriented programming language which is built on top 
of Common Lisp. It is used extensively in artificial-intelligence applications (Koschmann, 
1990, pg. 5). We chose CLOS for this part of the thesis because of its ability to handle 
complicated data structures and because of the graphics capabilities that came with the 
implementation that was supplied with our computer systems. Our implementation was 
Allegro Common Lisp from Franz. 

There are approximately 1000 lines of code in the program divided up into five files 
that are separated by function. Comments are sparse in the code because descriptive names 
were used for the variables, making comments redundant. It is possible to have global 
variables in a CLOS program, but it is not considered good programming practice, so there 
are none in this program. 

The correlation program (see Appendix D) starts by creating and initializing instances 
of a blackboard data structure for each pair of nearby hydrophones. Then it creates and 
initializes a data structure for the graphic output. The blackboard control program is then 
called sequentially for each nearby pair of hydrophones. After each set of nearby 


hydrophones 1s processed, regions are correlated between the far-apart hydrophones. 


34 


С. INPUT AND OUTPUT 


The input to the program consists of lists of regions with the identification of the region 
type as the first element of the list. This is the output from the identification program. There 
are four hydrophones to which sounds are correlated. The identification program only 
processes the sounds from one hydrophone, so it must be run four times covering the same 
time period during each run, in order to produce the files that are used by the correlation 
program. 

The output of the correlation program is an X-windows plot of identified and 
correlated regions in a time-frequency diagram (Figure 11(a) and (b)). The vertical axis is 
frequency from 0 to 64 Hertz. There are four hydrophones shown in the plot, so there are 
four vertical axes, all with the same scale. The nearby pairs of hydrophones are shown 
adjacent to each other on the plot, with the line between each pair corresponding to 64 Hertz 
on the lower hydrophone plot and 0 Hertz on the upper hydrophone plot. 

The horizontal axis is time. There is approximately 20 minutes of sounds in each plot. 
Each minute from the start of the plot is denoted by a tic mark below the lower hydrophone 
in each pair. All hydrophones were processed over the same time period so there are no time 
offsets of the regions between hydrophones. 

Regions are identified by a letter slightly above and on the right side of the region. 
Whales are identified with a “W”, t-phases with a “Q’’, unknowns with a “U”’, and others 
with an “O”. Correlated regions have a line drawn between them. The endpoints of the lines 
were determined by the middle pixel in the list of pixels for the region, so the angle of the 
line, especially between the nearby hydrophones does not represent the exact time offset 
for the correlation. 

The numbers above the upper pair of hydrophones and below the lower pair of 
hydrophones are the time offsets for the near-field correlations. They are in whole seconds 


and are referenced to the left side of the graph. 
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Figure 11: Graphs Produced by the Correlation Program. 
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D. BLOCK DIAGRAMS. 
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Figure 12: Diagram of Control Program. 
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RUN BLACKBOARD 
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HYRDOPHONE 
DATA FILES 


PROCESS NEW REGION 


MOVE REGIONS FROM 
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RUN-BLACKBOARD 


Figure 13: Diagram of Blackboard Controller. 





38 


MOVE REGIONS FROM 
UNMATCHED SLOT 


TO 
UNMATCHABLE SLOT 


NEW REGION 


MATCH NEW REGION 
TO REGIONS IN 
UNMATCHED SLOT 


MOVE MATCH TO 
POSSIBLE MATCHED SLOT 


MATCH NEW REGION 
TO REGIONS IN 
POSSIBLE MATCHED SLOT 












Figure 14: Diagram of Process New Region Program. 
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Figure 15: Diagram of Match Far Regions Program. 


E. DATA STRUCTURES 

There are four classes of objects in the correlation program. They are: the blackboard 
class, the hydrophone class, the region class, and the screen class. Each time the program 
is run, there are two blackboard objects, two hydrophone objects for each blackboard 
object, many region objects, and one screen object. 

The slots in the blackboard class are: phonel, phone2, screen-position, allowable- 
time-difference, unmatched-regions, definite-unmatched-regions, possible-matched- 
regions, definite-matched-regions, possible-region-matches, definite-region-matches, 
possible-region-match-time, and last-definite-matched-region-time. The blackboard class 
is a superclass of the hydrophone class through the phone! and phone? slots. 

The screen position slot in the blackboard class 1s initialized with the blackboard and 
indicates whether the hydrophones are to be plotted on the upper part of the screen or the 
lower part of the screen. It remains constant for the life of the object. This slot is necessary 
because there are two blackboard objects in the program. The allowable time difference slot 
is also initialized with the blackboard and remains constant for the life of the object. It is 
determined from input parameters that state the relative positioning of the hydrophones, the 
assumed speed of sound in the deep sound channel, and an error factor due to uncertainty 
about the deep sound channel characteristics. 

The unmatched regions slot in the blackboard class 1s a list of the region identifications 
of the regions that have not been matched to other regions and still fit within a time window 
where they might possibly be matched. The definite-unmatched-regions slot is a list of the 
region identifications of the regions that have not been matched to other regions and no 
longer fit within a time-window where they might possibly be matched. 

The possible-matched-regions slot in the blackboard class is a list of the region 
identifications that have tentatively been matched to another region, but still fit within a 
time window where another region might possibly be matched to them. The definitely- 


matched-regions slot is a list of the region identifications that have been uniquely matched 
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to another region and no longer fit within a time window where another region might 
possibly be matched to them. 

The possible-region-matches and definite-region-matches slots in the blackboard class 
are lists of lists of the region-identifications that are matched, combined with the goodness- 
of-fit value and the time delay between the region match. The possible-region-match-time 
and last-definite-region-match-time slots are used by the blackboard controller to 
determine whether it should implement the definite-matched-region knowledge source. 

The hydrophone class is a sub-class of the blackboard class. It contains the following 
slots: file, blackboard-id, phone-1d, latitude, and phone-time. The file slot is the name of the 
file that contains the region data for one hydrophone. It 1s supplied at the beginning of the 
program and remains constant for the life of the object. The blackboard-id slot corresponds 
to the screen-position slot from the blackboard class. The latitude slot is supplied as input 
to the initialization of the hydrophone and represents the relative position of the 
hydrophone to the other hydrophones. The phone-time slot corresponds to the start time of 
the most recently retrieved region from the input file. 

The region class contains the following slots: blackboard-id, phone-id, region-id, 
region-type, pixels, time-min, time-max, freq-min, freq-max, and area. The blackboard-id 
slot corresponds to the screen-position slot in the blackboard class. The phone-id slot is set 
to the phone-id of the relevant phone object. The region-id slot is a unique machine- 
generated identification by which the region can be identified. The region-type slot is a 
letter corresponding to the identified type of region. The region type is the first element of 
the input list. The pixels slot is a list of time and frequency values for each pixel in the 
region. The pixels make up the rest of the input for a region after the region type. The time- 
min, time-max, freq-min, and freq-max slots are the extremes of time and frequency for the 
region. They are calculated after being read. The area slot is the number of pixels in the 
region. 

The screen class has the following slots: id, borders, left, bottom, width, height, title, 


activate-p, lower-y-text-position, upper-y-text position. The id slot is the address of the 
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plot. The computer sends plotting commands to this address. The borders, left, bottom, 
width, and height slots in the screen class are for physical positioning of the plot on the 


graphics screen. The two text-position slots are for positioning text on the screen. 


F. PROGRAM COMPONENTS 

The control program performs the initialization of the data structures and calls on the 
major controlling components. Two blackboard objects and a screen object are created and 
initialized. Each blackboard object initialization call includes the names of the two files that 
contain the region data from the nearby hydrophones, the relative position of these 
hydrophones in nautical miles, and the relative screen position to which the output will be 
plotted. The relative physical positions were called “latitude” in order to avoid confusion 
with the screen position of the hydrophone output. After the blackboard objects are 
initialized, a screen object is initialized. The initialization of the screen object causes the 
graphics screen to display a plot. Once this is done, the blackboard controller for the first 
blackboard is invoked. This causes the first two nearby hydrophones files to be read and 
their regions to be correlated and displayed. After the data set for the first set of 
hydrophones has been exhausted, the blackboard controller for the second blackboard is 
invoked. With two blackboard objects of nearby correlated hydrophones completed, the 
control program calls on the far-apart-hydrophone matching program to match the matched 
regions from the two blackboards. 

When a blackboard object is created, the computer associates a name with the object 
and sets aside memory for that object to use. In the initialization of the blackboard, each of 
the two hydrophones are started. This involves opening their files for reading and adding 
the information about the hydrophone’s latitude and screen position to the hydrophone data 
structure. The blackboard’s screen position is added to its data structure, and the allowable 
time difference is determined from the latitude difference of each hydrophone divided by 


the assumed sound speed and multiplied by an uncertainty factor. 
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After the blackboard objects are initialized, the screen object is initialized. During the 
initialization of the screen object, the plot window is drawn to the screen, the lines 
delineating the minimum and maximum frequencies for the hydrophones are drawn, as are 
tic marks for each minute in time. 

Once the initialization is done, the blackboard controller is called for each blackboard. 
The blackboard controller is a recursive program. It first checks the phone-time slot for 
each hydrophone and gets the next region from the hydrophone with the oldest time. The 
hydrophones stay synchronized in time by getting regions in this manner. After a region is 
retrieved from the hydrophone file, the controller calls on a program to process the new 
region. Once the process-new-region program returns, the controller checks the time 
difference between the last possible region match and the last definite region match against 
the allowable time difference. If sufficient time has passed, the controller calls the program 
for moving region matches from the possible-matched-regions slot to the definite-matched- 
regions slot. After this is done, the blackboard controller calls itself. This continues until 
both hydrophone files have been exhausted. 

The process-new-region program starts by calling on a program to move regions from 
the unmatched-region slot to the unmatchable-regions slot. Regions are moved to the 
unmatchable-regions slot when they can no longer be matched to any new regions because 
the start times are too far apart. The process-new-region program then attempts to match 
the new region to all regions from the other hydrophone in the unmatched-region slot. A 
time-shift and overlap technique is employed for matching regions. The time element of 
each pixel in one region is modified so that it is time-correlated to the region to be matched, 
then a goodness-of-fit is determined from the amount of overlap between the two regions. 
If a match is made, both regions are moved to the possible-matched-regions slot. After the 
unmatched regions have been checked, an attempt is made to match the new region to all 
regions in the possible-matched regions slot. 

After the control program calls the blackboard controller for each of the two pairs of 


nearby hydrophones, it calls the program for matching far apart hydrophones. The far- 


match program first takes the list of definite-region-matches from one blackboard and 
matches each matched pair to all possible regions from the list of definite-region-matches 
from the other blackboard. This produces a list, for each nearby hydrophone pair, of far- 
apart region pairs with a goodness-of-fit and time-delay. The number of possible regions 
for matching is constrained by the travel time of sound between the two regions. After the 
far-apart matching 1s done for the regions from one blackboard, it is done for the other. Now 
there are two far-apart match lists, with each matched region from each pair of nearby 
hydrophones matched to all possible regions from the other set of nearby hydrophones with 
the goodness-of-fit and associated time delay. Each list of possible matches for each 
hydrophone pair 15 ordered, from best to worst, by the goodness-of-fit parameter. The time- 
shift transform is then determined from the matched lists. The time-shift transform is then 
applied to both matched lists. This modifies the goodness-of-fit numbers for each of the 
region matches for each far-apart pair of matches. This modifies the ordering of the list for 
each hydrophone, so each hydrophone is re-ordered, from best to worst, by the goodness- 
of-fit parameter. Once this 15 done, a get-best-matches program is called to determine the 
best matches between the two sets of far-apart hydrophones. It does this by finding all of 
the one-to-one correspondences between the best matches for each pair of regions. Lines 
are then drawn between the far-apart regions that have best matches. Once this is done, all 
of these regions are removed from the far-apart match lists. Then the get-best-matches is 


called again, followed by drawing lines between the additional best matches. 


G. ABANDONED ALGORITHMS 


The region matching algorithm for the nearby regions originally attempted to limit the 
matchable time delay based on the assumed speed-of-sound through the water and the 
distance between the hydrophones. This did not work because of the distortions that regions 
could go through during the identification phase. Some regions would have their front ends 


removed because of the pixel trimming that goes on in the low-level vision processing. The 
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fix for this simply involved putting in artificial positions for the nearby hydrophones that 
were farther apart than was actually the case. 

When attempting to match regions between the far apart hydrophones, the smallest 
region from the matched pairs of nearby regions was used for the time-shift and overlap 
comparison. This gave less satisfactory results than using the largest region from the 
matched pairs. 

Knowledge sources in a blackboard architecture are usually independent and can 
frequently act in parallel. We attempted to implement the blackboard controller to take 
advantage of this independence by having the knowledge sources called up as separate 
processes. This would probably have worked if a multi-processing computer was available 
or if multiple computers were used. Unfortunately, the process controller grabbed most of 
the processing time, giving very little to the multiple processes that were running. This was 
mostly due to the fact that every time a pixel was drawn to the screen, an interrupt occurred, 


causing a context switch. 
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VII. DISCUSSION OF RESULTS 


A. INTRODUCTION 

The identification program was very successful in identifying t-phase signals. Most 
calibration signals and whale moans were also identified. There were a few false 
identification problems with whale moans and also some whale moans that were classified 
as unidentified signals. 

The correlation program was successful in correlating regions to nearby hydrophones. 
It also successfully correlated regions to far apart hydrophones when all possible regions 
had been correlated to nearby hydrophones. False correlations tended to occur when the 


proper region on one hydrophone set was not available for correlation. 


B. IDENTIFICATION PROGRAM 

The identification program was run on a Sun Sparcstation 10. Although over 10 hours 
of data for 16 hydrophones were provided for this project, only 2.2 hours of data for four 
hydrophones were used due to disk space limitations. The data set for each run included 
approximately 1120 seconds of Fourier transformed data from one hydrophone. This size 
data set was chosen so that full use could be made of the screen width on the workstation 
when displaying the results of the correlation program. The average running time was 33.8 
minutes with a sample standard deviation of 13.7 minutes. The deviation is large because 
extremely noisy time periods caused the execution time to double over time periods that 
just contained whale moans. Execution time for a set which consisted exclusively of whale 
moans was approximately 21.7 minutes. The average memory use including program and 
data storage was 14 megabytes with a sample standard deviation of 2.4 megabytes. 
Memory usage for a set which consisted exclusively of whale moans was approximately 
12.2 megabytes. 

A comparison was made of the whale moans that were visually identifiable by a human 


and the whale moans that were identified by the program. There was one data set of 1120 
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seconds of sound that was strictly whale moans. During that data set, the program identified 
91.7% of 156 human-identified whale moans that were received on four hydrophones. 
During periods of seismic activity and high noise, the number of identifiable moans was 
reduced for both the human observer and for the program. Over four data sets that showed 
both seismic activity and high noise covering a total of 4480 seconds, there were 469 
human-identified whale moans, 68.9% of which were identified by the program. 

The number of false identifications was negligible. There were two instances where a 
region was identified as a whale moan when it was actually two moans that slightly 
overlapped. There was also a problem of whale moans being mistakenly identified in the 
section of the hydrophone recording that was extremely noisy. Over a 15 minute period of 
noisy data, where nothing is identifiable by human vision on the frequency plots of two 
hydrophones, there were 30 whale moans identified. The few calibration signals that 
escaped elimination in the low-level processing phase of the identification program were 
also sometimes identified as whale moans. 

There were many fewer t-phase signals in the data than whale moans, although t-phase 
signals tended to have a larger area. A single t-phase signal often consisted of many 
regions. Also, a t-phase signal can last for several minutes. One signal that was analyzed 
by the program lasted for 15 minutes across two data sets. All t-phase signals were properly 
identified by the program. There were a limited number of unidentified regions in the data 
that might have been associated with a t-phase signal, but in every case, there were several 
small regions near these unidentified regions that were identified as t-phase signals. Also, 
the author could not be certain that these regions were actually a part of the t-phase signal. 

Most of the calibration signals were removed in the low-level vision processing phase 
of the program. There was a small number of calibration signals that made it to the high- 
level processing and these were identified as unknown signals or whale moans. 

Signals that were not classified as whale moans, calibration signals, or t-phases, were 
Classified as unknown. The identifiable whale moans that were not classified as such were 


all classified as unknown. Also, unknown signals were often small parts of whale moans 
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that didn't get picked up in the same group as the rest of the signal. During the high-noise 
section of the hydrophone recording, there were many small regions of noise that were 


classified as unknown. 


C. CORRELATION PROGRAM 


The correlation program was run on a Sun Sparcstation 10. Regions covering 
approximately 1120 seconds of hydrophone data for each of four hydrophones were input 
on each run. The average CPU time for the correlation program was approximately 28 
minutes. 

Correlations of signals between near-field hydrophones are easily identifiable by 
human inspection. In the first data segment, which consists entirely of whale moans (see 
Figure 11), there should be 86 near-field matches. The program determined 81 (94.1%) of 
those matches. Similar results were obtained for all other data segments where there were 
whale moans to be correlated. 

The results were less satisfactory for t-phase signals. The identification program 
tended to break t-phase signals up into several different regions. Often, the manner in which 
these regions were determined was different for the near-field hydrophones. Over the span 
of seven data sets, covering 2 hours and 10 minutes, there were 365 regions identified as t- 
phase signals. Near-field correlations of these t-phase signals dropped to 42.7%. Part of the 
reason for this was that most of the programming effort concentrated on the correlation of 
whale moans. 

The symbolic correlation of signals to the far-field hydrophones is not obvious to the 
human observer. When looking at a plot of the signals without the far-field correlations 
connected, one can only visually correlate one or two whale moans per data set. After the 
far-field correlations are drawn, it is easier to see that the correlations drawn by the program 
are probably correct. This human verification after-the-fact is not good enough to claim that 
the far-field correlations are correct. Another approach was used to verify the program 


output. 
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For each pair of near-field correlated whale moans in the first data set, a Fast Fourier 
Transform correlation covering a 16 second time period was run against time delays for the 
possible matches to the far-field hydrophones. Figure 16 shows a correlation of a whale 
moan between two hydrophones with a sample data set covering 16 seconds. The 
correlation is between far-apart hydrophones in Figure 11(a) at the indicated times. Phone 
| is the lower hydrophone in the lower set of hydrophones and Phone 3 is the lower 
hydrophone in the upper set of hydrophones. The vertical axis is the magnitude of the 
correlation. The horizontal axis is in units of 1/128 seconds. The correlation is for eight 
seconds on either side of the of the selected time offsets. The correlation at the exact time 
offset is at the 1024 value point on the horizontal axis. The maximum correlation occurs 
slightly less than a second prior to that point and has a magnitude of approximately 6000. 
The two time offsets in this graph were selected because they match time offsets for a 


correlation chosen by the shape correlation program. 
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Figure 16: Far-Field correlation of a Whale Moan. 
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Sixteen-second FFT correlations were calculated every four seconds over the entire 
possible range of correlations for each whale moan in the first data set. The maximum 
magnitude within that correlation was then determined and saved. The maximum values for 
the correlations over the range of possible correlations were plotted. Figure 17 shows a plot 
of the maximum correlations of Phone 3 to Phone 1 at the 543 second time offset for Phone 
1. The maximum of these maximum-correlation values occurs at approximately the 765 
second time offset for Phone 3, as shown in Figure 16. This verifies the correlation chosen 


by the symbolic correlation program for this particular whale moan. 
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Figure 17: Maximum Far-Field Correlation Magnitudes. 


In the majority of the cases, these correlations provided verification that the 
symbolically chosen set of far-field correlations were correct. When the maximum 
correlation versus time plot was presented, there were sometimes peaks of similar size that 
would indicate that the correlation could be to any of two or three different whale moans. 
Figure 18 is a plot of maximum far-field correlations that have an ambiguous best 


correlation. 
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Figure 18: Maximum Far-Field Correlation Magnitudes. 


The FFT correlations validated the signal shape correlation algorithm. In the data set 
shown in Figure 11(a), there are 29 far-field whale-moan correlations. FFT correlations 
were calculated for each of the moans and the results were compared to the results of the 
shape correlation program. Of the 29 shape correlations, there were 19 moans where at least 
one FFT correlation between Phones 1 and 2 and Phones 3 and 4 had a maximum 
correlation at the same time offset. Twenty-five of the 29 moan correlations had a peak, 
corresponding to the time offset chosen by the shape correlation program, in the FFT far- 
field correlation magnitudes which was among the top three peaks. 

There were occasional errors made by the correlation program. The program did not 
attempt to correlate regions between far-field hydrophones if a near-field correlation did 
not exist. This sometimes caused a false correlation between far-field hydrophones. False 
correlations also took place at the end of the data set. The whale moans from the lower set 
of hydrophones consistently correlated to moans from the upper set of hydrophones with a 


large time offset. At the end of the data set, the moans that should have been correlated were 
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correlated for the upper hydrophones and there were moans in the lower set of hydrophones 
that would obviously correlate to moans from the upper set of hydrophones in the next data 
set. Without the next data set available, some of the uncorrelated moans from the lower set 
of hydrophones correlated moans from the upper set of hydrophones that should have 
remained uncorrelated. 

Almost all of the valid correlations of whale moans between the far-apart hydrophones 
showed a consistent time offset of approximately 240 seconds. This is near the limit of the 
possible straight-line travel time of sound between these two hydrophone pairs. The lower 
set of hydrophones shown in Figure 11 is south of the upper set of hydrophones. This 
indicates that the whale moans were coming from the south. 

When performing the far-field correlations of whale moans, the whale moans often had 
a goodness-of-fit value of over 0.7. This indicated that there was very little attenuation of 
the signal over the approximate 335 km distance between the hydrophone pairs. It also 
suggests that these low frequency whale moans may be coming from distances of many 


hundreds of kilometers south of the southern pair of hydrophones. 


53 


VIII. CONCLUSION 


А. INTRODUCTION 


The goals of this thesis have been met. The computer vision model properly identifies 
t-phase signals, whale moans, and calibration signals. The correlation program properly 
correlates whale moans between near-field and far-field hydrophones. 

These programs are not production quality programs. They are written in prototype 
languages and improvements could be made in the data structures and in the method of 
execution. However, they can serve as prototype programs for incorporation of the ideas 


presented into other programs. 


B. ACHIEVEMENTS 


There were major accomplishments of this thesis that can be of significant benefit to 
the research community. The first is that a method has been developed for unambiguously 
identifying t-phase signals received at submarine hydrophones. This has been a problem for 
geophysicists studying these signals. The other major accomplishment of this thesis 1s that 
a method has been developed for correlating signal shapes between both near-field and far- 
field hydrophones. This method is particularly applicable to the whale research community. 

Geophysicists studying seismic events in the northeast Pacific ocean basin have a set 
of software tools that allow them to scroll hydrophone data across the screen of a graphics 
workstation so that they can look for t-phase signals. By taking the ideas from this thesis, 
they can add some modules to that software and develop a reliable t-phase detector. There 
is also the possibility of using the identification techniques to develop an acoustic tsunami 
warning system. The ideas from the correlation program could be used to improve the 
current Correlation techniques. 

This thesis demonstrates a “proof-of-concept” for whale researchers that are 
interested in remotely tracking the migration paths of large open-ocean baleen whales. 


These whales are extremely difficult to monitor using traditional survey methods. A 
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method is presented here for automatically identifying whale moans and correlating them 


to both near-field and far-field hydrophones. 


C. WEAKNESSES 


The algorithm for the identification program turns on pixels in the low level processing 
based on a moving threshold. There is a target percentage of pixels that the algorithm wants 
turned on for each second in order to be able to develop distinct regions. This is sometimes 
a detriment when there is both an intense t-phase signal and whale moans occurring 
simultaneously. Often the whale signals lose a lot of their shape because their pixels move 
to the t-phase signal. 

In order for a program to effectively work with this data in a production fashion, it must 
process it in areal-time mode. The identification program does not work in this manner. An 
arbitrarily large section of data is handled at one time by the program. That entire section 
of data is manipulated several tmes during the low-level vision-processing phase of the 
program. The high-level vision-processing phase also performs each step with a view to the 
entire data set. The real-time quality of the software was not a concern during this thesis 
since the programs were not intended to be production programs. 

Another weakness of the programs written for this thesis is their speed. It takes 
approximately 2.5 hours of computation time to produce a single plot containing 20 
minutes of data. Since the programs were not intended as production programs, speed was 
not a concern. The incorporation of the ideas in this thesis into a production program can 
be done without a significant performance penalty. 

Finally, the methods used to do the symbolic correlation should be verified by use of 
Fourier transform correlation techniques. These techniques would also give a much more 


accurate time delay so that lines-of-position can be precisely determined. 
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APPENDIX A: SAMPLE OF RESULTS FROM 


IDENTIFICATION PROGRAM 
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group (50,171) ) 

emotions 1-72.) ) 

соло (52, 17 3) } 

grou (52, | 726, 74} } 
uoo 54. [75] 

GE OUD S5, [33,81,771 
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group 75, 1110)) 
срео (76, [112 4111) 
срео (77, [114] ) 

село 78, [115,116,1131) 
ЕО (79. |1118,117)) 
атор во: (1191). 
атоо ва (121, о 
па е ШАРА Б. 
group (8 aX 
group (84, [125,124]) 
Ем ШЕ 

ево 80, (127) 
Group (37,1128) } 
group (88, [129] ) 
ат ороо, (1:20) 
чао (90, (131) 
цтошр (91, | 1321). 
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Group Gualities(2 (12714522 22-27 13-000 
group qualities(3,43,60,25,34, 87, ба ден: 
Group qualities(4 712, 15,29) 3074, 216 505. 
group Gua bit ies(5, 33735-38367 sy 17 LOO 
Group qualities (6-37 62,3960. 183, SIF ONE 
group qualities(7,9,13, 40, 42, ЗА SE 
group qualities(8,24, 28, 59, pos 135 107 БЕ 
group-quoalitiest(9 36,602.59 12012155500 
group.cualities(t0.295,51 74589898. 121,99 33) 
groupogialities(11.55,52 8985289529», 43. 9501 
Group ама а гле ТА 257.02, 93 тоя, 139, 48,39). 
group_qualities (13, 34,61, 109, LIE, 179,59 A. 
Group qualiverves( 4.35613 2,146,484 5772 oo 
group-qualdtries(ib, 1,17. 144 145. 6,35 75). 
qroup qualit:es(16,34.60, 148.156,99 49. 36) 
group qualities(17,8, 12, LOL ISL SIS, LOO 
group qualities(18,24, 59, 159 1735132567424). 
group спа зЕтез (19, 54 , 55 ,159, 1592 62 1001: 
Group. cduallti1es (20,8, 10+ 173-173, 3- 12, 100). 
GeOup. qualities (21,40 762, ice s 1 ОБУ. 
Group dua lveves (22,29, 62, 136,201, ЗООС. 
Group2qualities (23543262 -206 217 79735732)" 
Group dualities (24 37/58 2297226 Тал oo. 
Group qualities (25,12,14,229, 229,326.00 i2 
Group Gua lit165(2676 1562, 286,256, 2,279,. 200). 
group cqualitjes(t27,7. 011.297.239. 8,50. 53). 
groupedquelrtrest25.58 010.254.255. 55.2 9093] 
group gualities(29,22,62,236,265,.298 64,23). 
group qualities (30,13,16, 260,260 4, 27, T00 
group сшатастес (3134 52, 266, 286. 172 580000 
Group спагігтев |32 7,10/280.250/4 2601005 
дгочр. чаша 1съез (33,11,14,286,286,4,12,100). 
group_qualities(34,39,43,290,293,8,46,40). 
Groupwoua li1ties (3524 7,62, 2593, 3047317462427) 
group qualities(36,27,29,308,309,5,29,83). 
qroup -quelirtri1eEes(37 , 40558-3508 314,70, 7/652). 
Group qualities (33, 7,9,310,210,3. 13,100). 
group qualities (39747753 ,216,310, 7-100. 100. 
Group Gqualwverves(40,57,62. 315,322, 13,4674 304 
Group sQualataes (41750, 62732553347 037509745) « 
Groupequaliveres (42,147 16,333) Оо) 
свопроаша ПЕтес 148 35. 38 339 28 O, OO. 
group qualirbres(44 47. 50-339 3239 4.9. 100)]- 
groupsquadJties(45 55.00.3421. 5347.0 298 пори 
groope-quablytiest49 13.15 346.3457. 5 531 је 
Group са 1Е1е5447 35 60 548, З60 132 вел зе. 
Groupvqualities (43,710,359 360,413.50) 
group qualities(49,40,62,364,373,91,58,39). 
groupcqual)ties([50 010.12,270059) 02555235. 892) 
group. qualities(51.32,59,29756,3895,124/7 55 Еј. 
group -qualieres( 52, 95.13, 386738077, 22540). 
агоцпр: асшапЕтез (53, За 62,293,417 110373) oo а 
Group qualities(54,55, 575297 39738 ЕТТЕ 
Group qualities (55,41,60,414,445,209., 32-32). 
Groupuquailitties(56,32,34,416-41). 4.17766). 
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group апа л Сзез (57, 25.40.423 445, 125 99 30). 
group qualities(58,24,28,450,450,5,144,100). 
етра са Јар ке (59.49, 55 450, 450, 7,105 100) 
group qualities (60,24,62,45/,470,145,/2,26). 
group qualities(61,49,56, 457,458, 11,112,68) . 
arouüup qualate*:es(62,33.,02,476,495.178.60,29). 
geoub*qualities(63,61,62,499,499,2,16,100). 
wmeupnwqualt:tres(64,39,602,503,524,129,55,24)- 
сто са телес (65, 3135, 522, 925, 17, 35, В5 |. 
ашощре спайтелес (66, 39, 57, 526, 535,51,39, 26). 
Сепо аоа їз с1е5 (67.47 261, 538,547, 52,50,34). 
group Gua Lites (68,37,62,5557571; 121,600, 27 )-. 
smeubpequalrt1es(69,34,62,574,588,162,58,37). 
сесиге ста зЕзез (70, 3161, 591, 602 ,154,50,41). 
go up qualities (7 1.36,62,611,6207143,58,52) . 
Geoup. cualities(7/2,29,6),625,646,200,55,27). 
macusequalities(73,53.55,025,625.3,142,100). 
Gaeoloreclalitves(74,32,50,652,659,83,56,54). 
group qualities (75,52,61,660,666,34,52,48). 
group_qualities(76,42,62,675,688,112, 66,38). 
Ceol. qualities (77,33,35,689,689,3,17,100). 
group qualities(78,37,61,688,706,141,45,29). 
group. qualities(79,44,62,709,729,129,48,32). 
Geoup qualities (80,34,42,732,741,53,38,58). 
кор cualities (81,47,60,743,.746,17,28, 30). 
group Qualities (82,31,39,752,754,19,51,70 
group. qualities(83,51,54,754,754,4,12,100 
group qualities(84,45,57,769,778,49,52,37 
group qualities(85,60,61,781,781,2,13,100 
group_qualities(86,3,10,782,782,8,5,100). 
group qualities(87,54,62,795,799,20,42,44). 
group_qualities(88,11,13,801,801,3,24,100). 
group_qualities(89,3,14,808,810,25,27,69). 
Group gqialities(90,3,5,821,821,3,6, 100). 
стойр Oualities(91,12,14,821,821,3;,11,100). 
group qualities(92,53,62,833,836,17,30,42). 
geoup^qualrtxes(93,7.14,836,847,46,35,47). 
group qualities(94,19,22,838,840,6,29,50). 
group qualities(95,32,37,840,844,25,64,83). 
group qualities(96,40,62,843,858,144,66,39). 
group qualities(97,23,28,868,868,6,7,100). 
group. qualities(98,51,54,868,868,4,21,100). 
group qualities(99,30,40,872,878,45,50,58). 
smscnmoNqualbrtres(c100,52,54 972.872.3543, 100)- 
group qualities(101,43,53,880,882,16,38,48). 
group qualities(102,52,54,1118,1118,2,27,66). 


) 
Та 
је 
) 


кома group (1,3, ([5]). 
umksnewunogroup(4,16.[25]). 
unsnewmnqroupt5.21.134,33])4 
undbspownctgroup(o,235.[40,39]). 
unknown group(7,34,[54]). 
Unknown ао (9235, 6551) 
unkmownvgroup(9.37.157]). 
unknown, group(10,40,[61,60]). 
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па а Ола сре опре таа 019219 
unknown group(12,43,[64]) 
Unknown Group (13,47. 68I. 
unknown, group(14,49,[70]) 
ünknownedgrouptb5s61] 8) 
unknown Group (16,65 -[95)) 
unknown group(17,66,[98, 97, 96:1) 
unknown_group (18,67, [99]) 
unknown group (19.70.(1041). 
unknown Group ( 20; 71 IOS. 
anknowneogroupt21. 74. | T09]5 
üunkuown-groupt(t22.75 (ЕКО) 
üunknown-cgroup(i23,B0, LII9 
зе чото орао е о ТО T121; 120]) 
unknown dgroupt25.82 1122] 

КЕ e NI 
ünknown -group (27:87 (Јава 
Unknown бтошр (28 92 |18277 
unknown агоир (30,99 ,(140)) 
Unknown group (3 F104. [42] } 


best line fití(1,3.92699E- 
01,8.310769330205034E+00,8.936860787545353E+01,1.96686578554254 
6E+00,5.5048320461 21 114E+00)). 
best_line_fit(2,0.0E+00,6.666666666666666E- 
01,6.666666666666666E-01,0.0E+00,0.0E+00). 
best_line_fit(3,3.92699E- 
01,4.864060736807142E+00,2.995710082833223E+01,1.35660598015771 
3E+00,2.604220836109694E+00). 

best line fit(4,2.748893E«00,1.442320293329162E400,1.8210589592 
88522E*00,3.467679539997935E-01,1.789105231333532E- 01). 

best line fi1t(5,0.0E400,6.666666666666666EÉ- 
01,6.666666666666666Е-01,0.0Е-00,0.0Е-00). 

best line #1 (6, 7.85398Е- 
01,5.99266765641066Е+00,4.947743342772709Е+01,3.968161666771911 
Е+00,2.227869489847912Е+01). 

best line fit(7,3.92699E- 
01,1.24022124221869Е-00,1.993488418904624Е-00,5.556897818880131 
Е-01,3.971365810953754Е-01). 

best line f1t(8,1.178097E«00,1.340075183857666E400,2.3461016394 
72814Е-00,7.994335220519558Е-01,8.717344091464707Е-01). 

best line fit(9,3.92699E- 
01,5.873938595058509Е-00,4.837144438620045Е-01,1.39121800810705 
Е+00,2.687877872530698Е+00). 

best line fit(10,3.92699E- 
01,6.20814414758197Е-00,5.291545010879767Е-01,1.732849949248802 
E+00,4.44991523848645E+00). 

best_line_fit(11,3.92699E- 
01,2.044337037890678E+00,5.38513338689388E+00,7.307223795709038 
E-01,7.255916318889889E-01). 

best line fit(12,3.92699E- 
01,5.742931453477842Е-00,4.369848090935798Е-01,1.80455897930269 
Е+00,4.565103761438595Е+00). 

best line fit(13,3.92699E- 
01,8.073903502210806E+00, 8.571803 842627608E+01,2.00817743376957 
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4E+00,6.492546576639387E+00). 

best_line_fit(14,3.92699E- 
01,7.658651150063783E+00,7.248707109104529E+01,1.69304840463405 
9Е-00,4.098832939811693Е-00). 

best line fit(15,3.92699E-01,9.725690848498098E- 
01,1.148590076431551Е-00,4.286549390719898Е- 

О а 125210346795603Е-01). 

best line #16(16,3.92699Е- 

Olvera 57225552028752E-00,3-320741577122268E-*01,1.421099392410706 
E+00,2.859531853424639E+00). 
best_line_fit(17,0.0E+00,1.2E+00,2.0E+00,0.0E+00,0.0E+00). 
best_line_fit(18,3.92699E- 

Ole 255047910040037E+00,1.113076501467854E+02 ,2.569582533805543 
Е>90, 1.017420361986031Е-01). 

рез line fit (19,0.0E+00,5.0E-01,2.5E-01,0.0E+00,0.0E8+00). 
best_line fit(20,0.0E+00,6.666666666666666E- 
01,6.666666666666666E-01,0.0E+00,0.0E+00). 
best_line_fit(21,3.92699E- 

01,5.476144549077222E+00, 4.070315981938675E+01,1.48722308328584 
7E+00,3.025641297288723E+00). 

best line fit(22,3.92699E- 

(1.7 712097045472777Е-400,8.733482516882495Е-01,2.04981068403393 
3E+00,6.826388759258818E+00). 

best line fit(23,3.92699E- 

01 1#651269405339635Е+00,3.305360740266237Е+01,1.52106413728622 
4Е+00,3.204781893113417Е+00). 

best, line fit(24,3.92699E- 
01,4.887628702434714Е+00,3.31452076662906Е+01,1.723438095964227 
Е+00,4.327691218210757Е+00). 

best І1іпе Ғ1Е(25,0.0Е-ғ00,6.666666666666666Е- 
01,6.666666666666666E-01,0.0E+00,0.0E+00). 

best_line_fit (26,0.0E+00,5.0E-01,2.5E-01,0.0E+00,0.0E+00). 

best line fit (27,2.748893E+00,1.323083134483586E+00,2.146587578 
914547EF+00,4.585569334063936E-01,2.641265631099703E-01). 
best_line_fit(28,0.0E+00,6.399999999999999E- 
01,5.599999999999999Е-01,4.800000000000011Е-01,2.4Е-01). 

best line fit(29,7.85398E- 
01,1.033834400904913E+01,1.498501275177333E+02,3.45453041995935 
SE+00,1.840361163311271E+01). 

best_line f1t(30,0.0E+00,1.0E+00,1.25E+00,0.0E+00,0.0E+00). 
best_line_fit (31,7.85398E- 
01,6.53511165006327E+00,6.246741985786708E+01,2.069677339906318 
Е-00,6.002532424575429Е-00). 


horgzontal 1ine(13,35,109,120). 
hormzontal line(18, 30,159,170) . 
Погшгопга! line(57, 24,427,445). 


whale (1,1,([3,2,1]). 
whame(2,6,[12,10,11,8]). 
упайе (3,9,115,14}). 
whale(4,10,[17,16]). 

мира ле (5,12.[21,20,191). 
whalle(6,13,[22]). 
whamwmei14.[23]). 
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whale 
whale 
whale 
whale(11,29,[46,48,43]) 
кита Сен РРА l1 (SS SOE 
whale(13,51,[72]). 
whale(14,53,[76,74]). 
whe let 15755, 133760) 7719- 
whale(16,57,[82,80,79]). 


( 
(on м5 Те m aHa) 
( 
( 
( 
( 
( 
( 
( 
whale(17,60,[88,86]) 
( 
( 
( 
( 
( 
( 
( 
( 
( 


10,24,[41]) 


whale(18,62,[91,90,89]). 
whale(19,64,[94,93]) 


мај је (20:68 10L IOJ 


whale(21,69,[103]). 
whale(22,72,[108,1060]) 
whale(23,765,|112,111]). 
ПАТЕТ а ТОТО ОО О) 
whale(25,79,[118,117]) 
whalet26.96.[137]9 


possible quake(1,7,[9]) 

possible quake(2, 27,1451) 
possible quake(3,52,[73]) 
possible quake(4,86,[127]) 
possible quake(5,89,[130]) 
possible quake(6,93,[134]) 


far quake(1,[9]). 
far quake(2,[45]) 
far quake(3 PUT 
far quake(4 EE 
far quake(5,[130]) 
far quake(6,[134]) 


oo OAS 
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APPENDIX B: PLOTS PRODUCED BY THE 


CORRELATION PROGRAM 





LLY y 
605 05 
605 В5у 





МИ les А 


P AI 


/ |. 


eu tette Hr 


А 


A Aine We 
ка 


517 СОР 666 
Ебу ytv 907 
115 бЕР OTP 5% 
5 YSF РЭС ТВЕ 


ТА ЧТОТО ТАУ 





P м“ mw + 


ШІН 


rang 


Е % 
LLOT 1с0т 
011 ВЕОТ 
т 
LOT 2201 


с: Име fs pst Nl 
AMI RI РУ 

MY 
2 


Ал? жа) he % X | хо = 
У „АЕ. D ф ang 


8 б 
4 т "d 


в ум Ре + 
хоро оц 1 


РЕР, д 





ТЕЛУ ТОР ТОТУ 


65 


2 у КУЧ i " » ~ о 
üt Pers я | б Dom MCA S 


ју 
P 


ЖОКЕ 


ТЕ6 188 808 ОР: 
9у6 868 108 692 STL 
Е56 106 628 SLL BEL 


дов 
Це, Р 


0p 


ТАС Р ТОТОУ 





66 


omi ; 
р Alli. КЛ AS 


РАНА 


| 
^+ 


hoc: 


1 г 
60Р TLE 862 
ЕВЕ 90€ 
886 ЗЕЕ 
РБЕ LSE 


Say HLpY Uomeay auoydoampapy 


PY 





67 


A 
` 


ШИИДЕ 
Y 





sayel Чогу eunda] 


68 


560Т 8501 800Т 999 119 Les OLD те» BLE 606 550 906 ват 911 

66011. 01201 919 919 ТӨР 69» ТОР SBE vee 690 SEZ 197 621 88 
ЕОТЕСОТ ВЕОТ 886 109 895 905 BYP vot ТРЕ 882 Sve 981 ЗЕТ ШТ 
118015501 966 4; 695 625 ض09‎ gor LOE bE 052 у6т 251 08 Е5 


Ц 0 | J i jw ШЫ 
2 | i 
A 


ut? ^ 20% („| А јег Ка ol 
A ў | 
; 


за 6 земе lh г aei HI а тал арка Ага nak 
ИН 


D 


/ 


АТ 
И ЙЛ 


и Шо) ., оғ. а (Т вм бъл 
a 1 ч “” Т 0 "dD b б Н 


ы 
Џ 


; 246 
e фа а 


EBZ 102 


ЛА РИО 





69 


APPENDIX C: PROLOG CODE FOR THE 
IDENTIFICATION PROGRAM 


* Incremental visual processing: operates line by line ona file. */ 
г“ Note: Бо амота гопасіпа a particular гео тот; ааа ап“ 
/* "uninteresting region" fact for it--will help avoid space overflow. */ 


:- no style check(single var), unknown(X,fail). 

:- dynamic lastrowegensym/1, region, name change/2, final. code/2, 
uninteresting region/1, pixel/3,pixel/4. 

/* SEEM SEEM SEEM SEEM SEEM SEEM SEEM SEEM SEEM SEEM SEEM SEEM SEEM SEEM */ 
:- dynamic lastwhalegensym/1, 

group. success/0, group/2, groupgensym/1, whale/3, outer, pixel/3. 

:- asserta(average lines(20)), asserta(threshold inc(7)). 

/* SEEM SEEM SEEM */ 


:- ensure loaded(vision4). 


demo :- demo(inputfile). 
demo(Infile) :- incrsum(Infile,sumfile), 

newg(70), incrxgrow(Infile,growfile), 
incrshapes(finalgrowpict,shapesfile), 
tell(xfinalgrowpict), xshow(finalgrowpict), told, 


high_level. 
rawdemo :- rawdemo(inputfile), do_lisp_regions. 
rawdemo(Infile) :- newg(20), incrxgrow(Infile,growfile), 


incrshapes(finalgrowpict,shapesfile), 
tell(xfinalgrowpict), xshow(finalgrowpict), told, 


high. level. 

/* Two ways to show a picture file: full data, or compressed data */ 
show(Infile) :- see(Infile), show2. 

show2 :- not(at.end of file), readlineclump(L), printlist(L), nl, show2. 
show2 :- seen. 

xshow(Infile) :- see(Infile), xshow2. 

xshow2 :- not(at. end of file), readlineclump(L), xprintlist(L), nl, xshow2. 
xshow2 :- seen. 

COE ime lS c(i) je 

xprintlist([NIL]) :- nember(N), code62(N,A), put(A). 1, репе ЕСО 
xprinttist(TlLIb])vewraete(rl). ІС рсе БЕСЕ 

code62(N,A) :- M is (N mod 62), M<10, !, A is M+48. 

code62(N,A) :- M is (N mod 62), M<36, !, A is M+55. 

code62(N,A) :- M is (N mod 62), !, А 156 М+61. 

incrsum(Infile,Outfile) :- incrmap4(Infile,Outfile,sum4). 
incrgrad(Infile,Outfile) :- incrmap9(Infile,Outfile,gradientthreshold9). 


incrgrow(Infile,Outfile) :- 
incrmapl(Infile,tempgrowfile,reverse threshold), 
incrmap9(tempgrowfile,tempgrowfile2,deorphan), 
incrclump(tempgrowfile2,finalgrowpict), 

pixel convert(finalgrowpict,temppixelfile), 
pixel. join(Infile,Outfile). 


/* General-purpose line-by-line 2D array processing: applies the given */ 

/* function to every 3 by 3 square in the array, outputs array of results. */ 
/* Function must be the name of a 10-argument (9-input) function predicate. */ 
incrmap9(Infile,Outfile,Function) :- see(Infile), tell(Outfile), 
readlineclump(L1), readlineclump(L2), readlineclump(L3), 
getamap9(L1,L2,L3,Function), !. 

getamap9(L1,L2,L3,Function) :- at. end. of. file, 
amapitem9(L1,L2,L3,Function,GL), write line(GL), 

seen, told, !. 

чесатаро (11.1213 „Ецпектод) :- amapitemo tb). b2,h39Püncpron Gb 

write line(GL), readlineclump(L4), getamap9(L2,L3,L4,Function). 
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/* Like above, but applies to 2 by 2 squares. */ 
/* Function must be the name of a 5-argument (4-input) function predicate. */ 


incrmap4(Infile,Outfile,Function) :- see(Infile), tell(Outfile), 
readlineclump(L1), readlineclump(L2), getamap4(L1,L2,Function), !. 
getamap4(L1,L2,Function) :- at, end of file, 


amapitem4 (L1,L2,Function,GL), write line(GL), 

seen, told, !. 

getamap4(L1,L2,Function) :- amapitem4(L1,L2,Function,GL), 
write line(GL), readlineclump(L3), getamap4(L2,L3,Function). 


/* Like above, but applies to single cells. */ 

/* Function must be the name of a 2-argument (1-input) function predicate. */ 
incrmapl(Infile,Outfile,Function) :- see(Infile), tell(Outfile), 
readlineclump(L1), getamapl(L1,Function), !. 
getamapl(L1,FPunction) :- at end of file, 

amapiteml(L1,Function,GL), write line(GL), 

seen, told, !. 

getamapl(L1,Function) :- amapiteml(L1,Function,GL), 

write line(GL), readlineclump(L2), getamapl(L2,Function). 


jo SEEM SEEM SEEM SEEM SEEM SEEM SEEM SEEM SEEM SEEM SEEM SEEM SEEM SEEM */ 
ПА ПЕВА БК SIRT SIRT SIRI SIRT SIRT SIRT SIR] SIRT STRT STRT STRT */ 
j* bike above but with dynamic threshold */ 

incrxgrow(Infile,Outfile) :- 
incrxmapl(Infile,tempgrowfile,reverse x threshold), 

incrmap9 (tempgrowfile,tempgrowfile2,deorphan), 
incrfill(tempgrowfile2,tempgrowfile3), 

get, lines(tempgrowfile3,tempgrowfile4), 

remove manmade signals(tempgrowfile4,tempgrowfile5), 

get. lines(tempgrowfile5,tempgrowfile6), 

remove manmade signals(tempgrowfile6,tempgrowfile?7), 

diagincrclump (tempgrowfile7,finalgrowpict), 

pixel convert(finalgrowpict,temppixelfile), 

pixel join(Infile,Outfile), 

get, pixel, values(Infile). 

incrxmapl(Infile,Outfile,Function) :- see(Infile), tell(Outfile), 
abolish(last line/1), abolish(intensity/4), asserta(last line(1)), 
readlineclump(L1), getamapx1(L1,Function), !. 
getamapxl(L1,Function) :- at.end.of file, last, line(Line), 

gradient, chreshold(G), assertz(intensity (Line,0,G,0)), 
amapiteml1(L1,Function,GL), write line(GL), seen, told, !. 
getamapxl(L1,Function) :- last, line(Line), gradient threshold(G), 
assertz(intensity(Line,0,G,0)), amapiteml(L1,Function,GL), 

get, average intensity(Line), abolish(iteration/1), asserta(iteration(0)), 
getamapx2 (L1,Function,Line,GL,NewGL), 

write line(NewGL), readlineclump(L2), NewLine is Line - 1, 


retract (last_line(Line)), asserta(last_line(NewLine)), 

getamapxl1 (L2,Function). 

getamapx2 (L1, Function, Line,GL,GL) :- iteration(6). 

getamapx2 (L1,Function,Line,GL,GL) :- intensity(Line,X,G,I), 

Du 5 X 10 

getamapx2 (Ll,Function,Line,GL,GL) :- intensity(Line,X,G,I), 

ИРА С 200. 

getamapx2 (L1,Function,Line,GL,GL) :- intensity(Line,X,G,I), 

E.G € 35. 

getamapx2 (L1,Function,Line,GL,NewGL) :- intensity(Line,X,G,I), X » 14, 


NewG is АТИ аса epe беле 15 (пе Gr) 
assertz (intensity (Line,0,NewG,0)), amapiteml1(L1,Function,GL2), 


get_average_intensity(Line), retract(iteration(Loop)), NewLoop is Loop + 1, 
asserta(iteration(NewLoop)), getamapx2(L1,Function,Line,GL2,NewGL). 
getamapx2 (L1,Function,Line,GL,NewGL) :- intensity(Line,X,G,I), X - 11, 

NewG is G - X / 2, newt(NewG), retract(intensity(Line,X,G,I)), 
assertz(intensity (Line,0,NewG,0)), amapiteml(L1,Function,GL2), 

get average intensity(Line), retract(iteration(Loop)), NewLoop is Loop + 1, 
asserta(iteration(NewLoop)), getamapx2(L1,Function,Line,GL2,NewGL). 

get average intensity(Line) :- intensity(Line,N,G,I), N > O, 
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retract(intensity(Line,N,G,I)), Avglis I / N, IntAvgl is integer(AvgI), 
assertz(intensity (Line,N,G, IntAvgI)). 
get average intensity (Line). 


reverse x threshold(A,*) :- gradient threshold(G), A«G,!. 
reverse x threshold(A,0) :- last line(Line), retract(intensity(Line,X,G,I)),!, 
NewI is I +A, Xpl is X+1, !, assertz(intensity (Line, xXp1,G,New!l)), w^ 

/* Fill in gaps across rows, columns, and diagonals to make fuller shapes */ 
incrfill(Infile,Outfile) :- see(Infile), tell (Outfile), readlineclump(Ll), 
readlineclump(([L2alL2]), readlineclump(L3), write line(L1), 
inertfill2(Lbl[b52alb2]2L32b3,Lh2a]95 een, told. 
lincrfill2[L1,b2.-,b3,b2hew2)] == аггецпа Of file уге ети 


write line(lL3), i. 

ОССЕ Е УО hoes, ЕЗ Еа ООо ОИЕ: = 
append(L2new1l,[L2b,L2c],L2new2), write line(L2new2), readlineclump(L4), 
jnecrrrlr2(bL2new2.[b3alb3orig])b54 а за је 


incrfill2((.ILb1];[.,O0IL2].[.I|I5b3],b3orig,L2newl) :- append(L2newi, [0], LC TCAE 
ІПСТЕТІТ ТЕ OEIC LICE Lo NEI 

ОПЕРЕТТА (ОЕТ Еа ТОД LICE, Loo ји = 

append (L2new1, [0),L2new2), inerfill2([L1b,0!1L1],L2,L3, L30rig, L2new2). 

ВИСЕ А А РО ЈЕ а а а ЕЗ та seria, Шота new 1) 5 
append(L2new1,[0],L2new2), incrfill2(L1,L2,[L3b,0|L3],L3orig,L2new2). 
incrfill2([_,0I1L1), (_IL2), (_,01L3],L30rig,L2newl) :- аррепа (12пежм1, | 0 |, В леи 
ЛО А О (ГОЛ ЕЦ Уе Шс рс өы» гел = ой 
їпсгїї112([_|11],(0,_,0!12],[(_!1Ь3],Ь3ог1їа,12пенш1) :- аррепа (12пежм1 , |О| Ше ии 
ТПСТЕТШІІЗ ТЕГТІ ОП L3 baer ig, Geanew2) = 
incrfill2([l.iL1],[.,*1L52],[.IEb3],L3orig,L2newl) :- аррепа(12пем1, (“| ІЗТЛЕГ и 


НС а А Је (iets bs B3orig b29]ew2). 


/* Find man-made signals and mark them uniquely. */ 
get lines(Infile,Outfile) :- see(Infile), tell(Outfile), readlineclump(L1), 
readlineclump(L2), readlineclump(L3), get cal signal(L2, L287, 
get сат тала Еа за) иисе | трпе је 
get lines2(L1,L2s,L3s,L3s,(]), seen, told, !. 
get-lines2(L1,;b2,L3old,L3,b2new) :- at end of file, write ітпе (221; 
write Iine(tb3). 1. 
get 13]ese21[*;m;ml, [5*;0,0].L3.L30*Id,b2newl). c 
append(L2new1,[*,m,m],L2new2), get lone pixels(L2new2,[]l,L2new3), 
write line(L2new3), readlineclump(L4), 
get ca3l-cesjgHal(Lh4jLbL4s),-cger-iines2(L2new2. b3o0p1g?b425. 54s dm 
get-Iinmes2i451,[5920750]; 1720940] ЕЗ еј „Па НЕ Ја 
append(L2newl,[*,m,m],L2new2), get lone pixels(L2new2,[]l,L2new3), 
write line(L2new3), readlineclump(L4), 
get-cal-signal(L4.b4s). get lines2(L2new2:- Lorg, LAS LAS Bb 
get lines2(L1,(L2a,L2b,L2c],L3,L3orig,L2new1) :- 
append(L2new1,[L2a,L2b,L2c],L2new2), get, lone pixels(L2new2,[],L2new3), 
write line(L2new3), readlineclump(L4), 
get cal.signal(L4,L4s), get lines2(L2new2,L3orig,L4s,L4s,L3a). 
Sel LINES, *Ib1] [55020 * 52] | *, * а ШТ оса Поле = 
append(L2new,[*,m,m],L2new2), 
чес пега (РА ЕЈ T IE2 (У ва ве те Попето 
сег 1лпез2( < mr q*0. D. 552] ol нога сер те а = 
append(L2new,[*,m,m],L2new2), 
get-liumes2rptriblpq*oESTqoqpewqp3Sr.5sortigsb2new2)e 
get 1ines24«[*,t *t,mlh1]. 1.0/0. ILA. (<, ONLI LOLI Ln ee 
append(L2new,([*,m,m],L2new2), 
get пеар L ре ра T*l53L. b3orig L2new27. 
еса тле (Гоо О ОТО Е По ЗС ШОН ЕЕЕ Г кор аек 
append(L2new,([*,m,m],L2new2), 
get LINES CI ILI TILA по Зет ето Зе фа Бон кеј LORS 
сег Тупез2 4 | е mm ILII ОО LAIT „Ъза 131 ІЗоТІП, І2лем) 5 
append(L2new,[*,m,m],L2new2), 
get Рупе (РАДО ај реза LISTING ONO. 
сес 11пес2 (| аа Вей мат | Ра а а у РОА ТЕЗІ ізеті ПОЛЕ КЕ 
append(L2new,[*,m,m],L2new2), 
сес пега Тара) F IL2 ва Је зе тера вапема је 
дева Језа ЕРИ ја а ва јр Т ва Јаве ле коте wc 


синь Ў ань Й ань 
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append (L2new, [L2a],L2new2), get lines2(L1,L2,L3,L3orig,L2new2). 


Дж Епа the characteristic calibration signal and change signals to match. */ 
Е лс сла RD ек к квк =, 
* * * 
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set to calsignal((],Ls,Ls). 

set to calsignal([*lIlL],Ls,Lsnew) :- append(Ls, [*],Lsnew2), 
set to calsignal(L,Lsnew2,Lsnew). 

set to calsignal([OlL],Ls,Lsnew) :- append(Ls,[c],Lsnew2), 
set to calsignal(L,Lsnew2,Lsnew). 


/* Get pixels that have no upper or lower neighbor and transform into an m */ 
/* These pixels will be put with the group of probable man-made pixels. */ 
get lone pixels([],Ls,Ls). 

get lone pixels([*,0],L,Ls) :- append(L,[*,m],Ls). 

get lone pixels((*,0,*lIRest],L,Ls) :- append(L,(*,mj,Lnew), 

get lone pixels([*iRest],Lnew,Ls). 

get lone pixels([L1l|Rest],L,Ls) :- append(L,ÍL1],Lnew), 

get lone pixels(Rest,Lnew,Ls). 


/* Remove all the m and c markings from a file. */ 
remove manmade signals(Infile,Outfile) :- see(Infile), tell(Outfile), 
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readlineclump(L1), remove, manmade. signals2(L1,X), seen, told, !. 


remove manmade signals2(Ll,Ll1new) :- at.end of file, write line(L1), !. 
remove manmade signals2([m],L1) :- append(L1,[*],Ll1new), write. line(Llnew), 
readlineclump(L2), remove manmade signals2(L2,[]). 

remove manmade  signals2([X],L1) :- append(L1,[X],L1new), write line(Llnevw), 
readlineclump(L2), remove manmade signals2(L2,[]). 

remove manmade. signals2([mlL1],L1new) :- append(Llnew,[*],L1newer), 

remove manmade signals2(L1l,L1newer). 

remove manmade signals2([clL1],L1new) :- аррепа(Џ пем, [*],Llnewer), 

remove manmade signals2(L1l,Ll1newer). 

remove manmade signals2([XIL1],L1new) :- append(Linew, [X],Llnewer), 


remove manmade, signals2(L1,L1newer). 


/* Remove pixels that have no upper or lower neighbors. */ 
/* This will tend to get rid of any straight (man-made) lines in the data. */ 


remove lone pixels(Infile,Outfile) :- see(Infile), tell(Outfile), 
readlineclump([X|L1]), remove lone pixels2(I[XIL1],[X]), seen, told, !. 
remove lone, pixels2(Ll,Ll1new) :- at. end of file, write line(L1), !. 

remove lone pixels2([X1,X2],L1) :- append(L1,[X2],Ll1new), write line(Ll1Hhe P 
readlineclump([X3]L2]), remove lone pixels2([X3J]E2]., [X3] ). 

remove lone pixels2([*,0,*I|L1],Ll1new) :- append(Linew, [*],Llnewer), 

remove lone pixels2([*,*lIL1],L1newer). 

remove lone pixels2([X1,X2l]L1],L1new) :- append(Ll1new,[X2],L1newer), 


remove lone pixels2([X2l|L1],L1newer). 


get pixel values(Infile) :- see(Infile), readlineclump(L1), 
get line, values(1,L1),seen. 

get. line values(Line,List) :- at. end of, file, 

get, line values2(1l,Line,List). 

get line, values(Line,List) :- get line values2(l,Line,List), 


NewLine is Line « 1, readlineclump(NewList), 
get line. values (NewLine,NewList). 
get line values2(Row,Lbine,[]). 


get line values2(Row,Line,[First|Rest]) :- pixel(Row,Line,X), 
retract(pixel(Row,Line,X)), assert(pixel(Row,Line,X,First)), 
NewRow is Row * 1, get line, values2 (NewRow,Line,Rest). 

get line valilues2(Row,Line,[Firstl|Rest]) :- NewRow is Row + 1, 


get. line values2(NewRow,Line,Rest). 


Да 

look for vertical line :- last line(Line), numzeros(Line,Zeros), 

Lineml is Line - 1, numzeros(Lineml,ZerosLml), Dif is Zeros - ZerosLml, 
abs (Dif: AbsDif); AbsDif > 14, азсекб2 (чекстсай 3 пера шеф ~ 

look, for. vertical. line. 


avi 
/* Group nearby regions together. Find whales, calibration signals, ... */ 
high, level :- circumference, get group, reorder groups, characterize groups(1), 


get, horizontal lines, get, vertices, get whale, get calibration. signals, 
get, earthquakes, get unknowns, get unknown, group qualities, 
get more whales, print. results. 


/* Find the outer pixels in each region and assert them. */ 

/* This keeps us from having to test every pixel in every region to see 

if two regions are in the same group. */ 

circumference :- abolish(outer pixel/3), circumference2(1). 

circumference2 (Region) :- do_circumference (Region), NewRegion is Region + 1, 
area (NewRegion,X), circumference2 (NewRegion). 

circumference2 (Region). 


do, circumference(AreaNo) :- pixel(X,Y,AreaNo,. ), not(inner pixel(X,Y,AÀreaNo)), 
assertz(outer pixel(X,Y,AreaNo)), fail. 
со circumference(AreaNo). 

inner pixel(X,Y,AreaNo) :- pixel(X,Y,AreaNo,.), 

left(X,Y,AreaNo), right(X,Y,AreaNo), up(X,Y,AreaNo)], downiX, Y,AreaNOUM 
left(X,Y,AreaNo) :- LeftCell is X-1, puixel(beftcell, Y, AReaNO m) 
right(X,Y,AreaNo) :- RightCell is X1, рзхеј(кјаћс се еху Агес пон је 

чр (Х, Т,АгеаМмо) :- ЏЧрсе1] 15 у+1, рахе1(х,Џрсе11,Акеамо,_). 
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down(X,Y,AreaNo) :- DownCell is Y-1, pixel (X,DownCell,AreaNo,_). 


/* Group nearby regions together into groups of regions. */ 

get group :- abolish(lastgroupgensym/1), abolish(group/2), get. group(1). 
get group(Region) :- get group2(Region), NewRegion is Region + 1, 
area(NewRegion,X), get group(NewRegion). 

get group(Region). 


get group2(R1) :- abolish(group success/0), lastgroupgensym(GroupID), 

Gid is GroupID, get group3 (R1,GroupID,Gid),combine, regions (R1,GroupID). 

get group2(R1) :- groupgensym(K), assertz(group(K,[R1])), get. group4 (R1,K), 
combine regions (R1,K). 

get group3(Ri,GroupID,Gid) :- GroupID « Gid « 3, get group4(R1,Gid), 

group, success. 

get group3(Rl,GroupID,Gid) :- GroupID < Gid + 3, NewGid is Gid - 1, 

get group3(Ri,GroupID, NewGid). 

get group4(Ri,GroupID) :- group(GroupID,Glist), member(R1,Glist), R2 is R1 + 8, 


add nearby. groups (R1,R2,GroupID), asserta(group success). 


ЖІП а region is near a group, then add it to that group. */ 

add nearby. groups (R1,R2,GroupID) :- R2 » R1, group(GroupID,Glist), 
not(member(R2,Glist)), nearby(R1,R2), append([R2],Glist,NewGlist), 
retract (group (GroupID,Glist)),assertz (group(GroupID,NewGlist)), 

R3 is R2 - 1, add_nearby_groups(R1,R3,GroupID),!. 

add nearby groups(R1,R2,GroupID) :- R2» R1, R3 is R2- 1, 

add nearby. groups (R1,R3,GroupID), !. 

add, nearby. groups (R1,R2,GroupID). 


/* If a region is a member of two groups, then combine the two groups. */ 
combine_regions(R1,G1) :- G2 is Gl - 8, combine_regions2(R1,G1,G2). 
combine_regions2(R1,G1,G2) :- G2 < Gl, combine_groups(R1,G1,G2), 63 15 62 + 1, 
combine_regions2(R1,G1,G3). 

combine _regions2 (R1,G1,G2). 


combine_groups(R1,G1,G2) :- Gl =\= G2, group(G1,Gllist), member(R1,Gilist), 
group (G2,G2list), member(R1,G2list), union(Gllist,G2list,G3list), 
Boetact (group(G1,Gllist)), retract (group(G2,G2]list)), 


assert (group (Gl,G3list)). 
combine. groups (R1,G1,G2). 


/* Find out if two regions are close enough together to be called nearby. */ 
nearby (Rl1,R2) :- outer pixel(X1,Y1,R1), outer. pixel (X2,Y2,R2), 

ЕЕН Е ХИ OIC IS Yl = Y2, Dast 1e Xdjf * Xdif « Ydif * Ydif, 

past 13. 


/* Due to group combining, there are missing numbers in the groups. */ 
/* Need to have a straight sequence of groups for later processing. */ 


reorder groups :- lastgroupgensym(Gmax), get start groups (G1,G2,Gmax), 
reorder, groups2 (G1,G2,Gmax). 

reorder_groups2 (G1,G2,Gmax) :- G2 < Стах + 1, group(G2,G21), Gipl is G1 + 1, 
Memieaet (Groupi(G2, G21) ), assertz(group(Gi1pl,G21)). G2pl is G2 + 1, 


get nonempty group(G2p1,G3,Gmax), reorder, groups2 (Glp1,G3,Gmax). 
reorder. groups2 (G1,G2,Gmax). 


/* Return Gl as the first empty group, and G2 as the first non-empty group */ 
get start groups (G1,G2,Gmax) :- get empty group(1,G1p1), Gl is Glpl - 1, 
С1р2 185 С1р1 + 1, get nonempty group(Glp2,G2,Gmax). 


/* Return next valid group number */ 


get, nonempty group(Gl1,Gl,Gmax) :- group(G1,G11). 

get nonempty group(í(Gl,G1,Gmax) :- Gl » Gmax. 

get nonempty group(G1,G2,Gmax) :- G3 is G1 « 1, get nonempty group(G3,G2,Gmax). 
/* Return next invalid group number */ 

getsemptysgroup(Gl,;Gl) :- not(group(Gl.Gll)). 

get, empty. group (G1,G2) :- G3 is G1 « 1, get. empty group (G3,G2). 


/* Find out the basic parameters for each group and assert them. */ 
characterize groups(Group) :- group(Group,Gl), character. groups2 (Group), 
NewGroup is Group *« 1, characterize, groups (NewGroup). 


Ша 


characterize groups (Group). 

character groups2(Group) :- group(Group,Glist), 

character groups3(GllIst,Xmin,Xmax,Ymin,Ymax,Area,IntDPct; ImcAVg lI) 
assertz (group qualities (Group, Xmin,Xmax,Ymin,Ymax,Area,IIntAvgI,IntDPct)). 
character, groups3 (Glist,Xmin,Xmax,Ymin,Ymax,Area,IntDPct,IntAvgI) :- 

get bounding box(Glist,Xmin,Xmax,Ymin,Ymax), get area(Glist,Area), 

get density (Xmin, Xmax,Ymin,Ymax,Area,Density), 

IntDPct is integer (Density), 

get total intensity(Glist,Loudness), Avgl is Loudness / Area, 

IntAvgI is integer(AvgI). 


get_bounding_box(Glist,Xmin,Xmax, Ymin, Ymax) :- get_xmin(Glist,Xmin), 
get xmax(Glist,Xmax), get ymin(Glist,Ymin), get ymax(Glist,Ymax). 
get xmin(Glist,Xmin) :- get, xmin2(Glist,99999,Xmin). 

ОВЕ ОТП min; n)- 

get xmin2(([GlList],Tempmin,Xmin) :- xmin(G,Min), Min « Tempmin, 
Gece xmin2 (bist, Min, Amin) 

get xmin2((GlList],Tempmin,Xmin) :- get xmin2(List,Tempmin,Xmin). 
get, xnax(Glist,Xmax) :- get xmax2(Glist,0,Xmax). 

get xmax2([],Xmax,Xmax). 

get xmax2(([GlList]),Tempmax,Xmax) :- xmax(G,Max), Max » Tempmax, 
get. xmax2 (List,Max,Xmax). 

get xmax2(([GlList],Tempmax,Xmax) :- get, xmax2(List,Tempmax,Xmax). 
get ymin(Glist,Ymin) :- get ymin2(Glist,99999,Ymin). 

get vmimn2st[].Ymin, Ymimi- 

get ymin2(([GlList],Tempmin,Ymin) :- ymin(G,Min), Min « Tempmin, 
get ymin2(List,Min,Ymin). 

get ymin2((GlList],Tempmin,Ymin) :- get ymin2(List,Tempmin,?Ymin). 
get ymax(Glist,Ymax) :- get ymax2(Glist,O,Ymax). 

get ymax2([],Ymax,Ymax). 

get ymax2([GlList],Tempmax,Ymax) :- ymax(G,Max), Max » Tempmax, 
get ymax2(List,Max,Ymax). 

get ymax2((GIiList],Tempmax,Ymax) :- get, ynax2 (List, Tempmax, Ymax). 
get area(Glist,Area) :- get area2(Glist,O0,Area). 

get, area2([],Area,AÀrea). 

get area2(([GlList],OldArea,Area) :- area(G,PartArea), 


NewArea is OldArea + PartArea, get_area2(List,NewArea,Area). 
get_density (Xmin, Xmax, Ymin, Ymax,Area,Density) :- 

Xdif is Xmax - Xmin + 1, Ydif is Ymax - Ymin + 1, BOxArea is Xdif * Ydi 
Density is 100.0 * Area / BoxArea. 


get total intensity(Glist,Loudness) :- abolish(loudness/1), 
asserta(loudness(0)), get, total intensity2(Glist),loudness(Loudness). 

get total, intensity2(([]). 

get total intensity2([RILD]) :- pixel (X,Y,R,Loud), retract (loudness (Loudness) ), 
NewLoud is Loud + Loudness, asserta(loudness(NewLoud)), fail. 

get total intensity2([RIL]) :- get. total, intensity2(L). 

/* Find all of the horizontal lines in the data set */ 

get horizontal lines :- abolish(horizontal. line/4), get horizontal lines(1). 
get horizontal lines(Group) = droup(Group.Gliet). 


add group. field to outer. pixels(Group,Glist), 

get. horizontal lines2 (Group), 

NewGroup is Group -*« 1, get horizontal lines(NewGroup). 

get, horizontal lines(Group). 

get horizontal. lines2 (Group) :- 

bagot( (X,Ylist), bagof|Y,R^outer DIxel(X,Y,R.Group)e Ylyst]o ХҮІІІ 
get. horizontal. lines3 (Group, XYlist). 

get _horizontal.limes2 (Group; List). 

get horizontal lines3(Group,í(]). 

get horizontal lines3(Group,[(X,Ylist)|XYlist]) :- length(Ylist,Ylem) s 
Ylen ».8, min(Ylist,Ymin), max(Ylist, ymax), YOGI 1S max чили в 
Density is Ylen / Ydif, Density » 0.5, 

assertz (horizontal line(Group,X,Ymin,Ymax)), 

get -horizontal-rIines3(Group.XYlist)s 

det horizontal lines? (Group, ((%, Ylist) /xviice |). se 

get horizontal, lines3 (Group, XYlist). 


/* Take the 3 argument outer pixel facts and associate a group with them */ 
add, group, field to outer. pixels(Group,(]). 
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add group field to outer pixels(Group,(RegioniGlist]) :- 
change outer pixels (Group,Region), 
addegroup field to outer pixels(Group,Glist). 


cEShgewouter pixels(Group,Region) :- outer pixel(X,Y,Regilon), 
Petract(outer pixel(X,Y,Region)), assertz (outer pixel(X,Y,Region,Group)), 
fall. 


change. outer. pixels (Group,Region). 


/* Find intersections between horizontal and vertical lines and assert vertex.*/ 
get vertices :- get verticesl1, remove duplicate vertices. 

get vertices1 :- vertical line(Y), get vertices2(Y), retract(vertical line(Y)), 
get vertical. edge. regions(Y,Rlist), assertz(vertical, edge(Y,Rlist)),fail. 

get verticesl. 


get vertices2(Y) :- horizontal .line(Group,X,Ymin,Ymax), Ydif is Ymax - Y, 
mpeirdir,AbsYdlit), AbsYdif « 5, group(Group,Glist), 

not (vertex(Group,Glist,X,Y)), assertz(vertex(Group,Glist,X,Y)), fail. 

сев vertijces2(Y) :- horizontal .line(Group,X,Ymin,Ymax), Ydif is Ymin - Y, 
absurgif,AbsyYdif), AbsYdlf « 5, group(Group,Glist), 
not(vertex(Group,Glist,X,Y)), assertz(vertex(Group,Glist,X,Y)), fail. 
qgecdevertjces2(Y) :- horizontal.line(Group,X,Ymin,Ymax), Y »- Ymin, Y =< Ymax, 
uünoupioroup,Glist), not(vertex(Group,Glist,X.,Y)), 
assertz(vertex(Group,Glist,X,Y)), fail. 


get vertices2(Y). 


/* Take the vertical edge and associate it with an appropriate region */ 
get vertical, edge regions(Y,Rlist) :- 
SCOR Group X outer pixel[(X,Y,B,Group), Е зес), 


/* There may be several Y intercepts for the X lines. Just take nearest. */ 
remove duplicate vertices :- vertex(Group,Glist,X,Y1), vertex(Group,Glist,X,Y2), 
x iNomsyzontal lne(Group,X,Ymin,Ymax), Ydifl is Ymax - Yl, 

Пе AnbsrYditl), AbsYdilfi - 5, Ydlt2 is Ymax = Y2, abs(Ydif2,AbsYdlf2), 
AbsYdif1 « AbsYdif2, retract(vertex(Group,Glist,X,Y2)), fail. 

remove duplicate vertices :- vertex(Group,Glist,X,Y1), vertex(Group,Glist,X,Y2), 
nos -vYlhorizontal line(Group,X,Ymin,Ymax), Ydifl ls Ymax - Y1, 
ареала 51 Абета1Е1), AbsyYdifl < 5, Ydif2 is Ymax - Y2, abs(Ydif2,AbsYdif2), 
AbsYdifl »- AbsYdif2, retract(vertex(Group,Glist,X,Y1)), fail. 

remove duplicate vertices :- vertex(Group,Glist,X,Y1), vertex(Group,Glist,X,Y2), 
a vl errzontal !ine(Group,X,Ymin,Ymax), Ydifl is Ymin - Yi, 

abs там AbsYd)If1), AbsYdlfi « 5, Ydif2 15 Ymin = Y2, abs(Ydif2,AbsYdif2), 
рана < AbSYGif2, retract (vertex(Group,Glist,X,Y2)), fail. 

remove duplicate vertices :- vertex(Group,Glist,X,Y1), vertex(Group,Glist,X,Y2), 
Nu = у! погогонга! i1ine(Group,X,Ymin,Ymax), Ydifl is Ymin = Yl, 
abs(Ydifl,AbsYdif1), AbsYdif1 « 5, Ydif2 is Ymax - Y2, abs(Ydif2,AbsYdif2), 

| AbsYdif1 >= AbsYdif2, retract (vertex (Group,Glist,X,Y1)), fail. 
remove_duplicate_vertices. 





| 
| 
| 


/* Find all the whale sounds in the data set. */ 
get whale :- abolish(lastwhalegensym/1), abolish(whale/3), get whale(1). 
get whale(Group) :- group(Group,Glist), get whale2(Group), 
NewGroup is Group + 1, get_whale(NewGroup) . 
get whale(Group). 
get whale2(Group) :- 
| group. qualities (Group, Xmin, Xmax, Ymin, Ymax,Area,Loudness,Density), 
Xmin » 20, Ylength is Ymax - Ymin, Ylength » 12, Ylength « 60, Area » 50, 
Area « 500, Density » 8, Density « 75, whalegensym(K), 
group(Group,Glist), assertz (Wwhale(K,Group,Glist)). 
get, whale2 (Group). 


"ndosthe- caljbration signals in the data set. */ 

/* Calibration signals are listed by time (YMIN,YMAX), instead of by regions.*/ 
| get calibration. signals :- abolish(low calibration .signal/1), 

| abolish(overtone region/3), abolish(overtone pixel/4), 

abolish(calibration signal/4), get low calibration, get overtone. 


/* The calibration signals are found by keying on the lowest tone. */ 
get low calibration :- 
group. qualities (Group, Xmin, Xmax, Ymin, Ymax,Area,Loudness,Density), 
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Area » 10, Xmax « 4, group(Group,Glist), 
assertz(low calibration signal(Group,Glist)), fail. 
get low calibration. 


/* The overtone signals are found after the low signal is identified. */ 

get overtone :- low calibration, signal(LowGroup,Glist), 

get overtone regions(LowGroup), get, overtone groups(LowGroup), 

eliminate extraneous pixels(LowGroup), get calibration params(LowGroup), 
рани 

get overtone. 
get overtone regions(LowGroup) :- 

group. qualities (LowGroup,Lxmin,Lxmax,Lymin,Lymax,Larea,Lloudness,Ldensity), 
ymin(R,Rymin), Rymin > Lymin, Rymin < Lymax, 

group (LowGroup,Glist), not (overtone_region(LowGroup,Glist,R)), 
assertz(overtone region(LowGroup,Glist,R)), fail. 
get overtone regions(LowGroup) :- 

group. qualities (LowGroup,Lxmin,Lxmax,Lymin,Lymax,Larea,Lloudness,Ldensity), 
ymax(R,Rymax), Rymax » Lymin, Rymax « Lymax, 

group(LowGroup,Glist), not (overtone_region(LowGroup,Glist,R)), 
assertz(overtone. region (LowGroup,Glist,R)), fail. 
get, overtone regions(LowGroup) :- 

group. qualities (LowGroup,Lxmin,Lxmax,Lymin,Lymax,Larea,Lloudness,Ldensity), 
ymax(R,Rymax), Rymax » Lymax, ymin(R,Rymin), Rymin « Lymin, 

group (LowGroup,Glist), not(overtone_region(LowGroup,Glist,R)), 
assertz(overtone region(LowGroup,Glist,R)), fail. 
get overtone regions(LowGroup) :- 

group qualities(LowGroup,Lxmin,Lxmax,Lymin,Lymax,Larea,Lloudness,Ldensity), 
ymax(R,Rymax), Rymax > Lymax, ymin(R,Rymin), Rymin < Lymax, 

group (LowGroup,Glist), not (overtone_region(LowGroup,R)), 


assertz(overtone region(LowGroup,Glist,R)), fail. 
get overtone regions(LowGroup). 
get overtone groups(LowGroup) :- overtone region(LowGroup,LGlist,Region), 


group (G,Glist), member(Region,Glist), 

not (overtone, group(LowGroup,LGlist,G,Glist)), 

assertz (overtone group(LowGroup,LGlist,G,Glist)), fail. 
get overtone groups (LowGroup). 


/* Sometimes regions extend beyond the calibration signal. Pixels from these 
regions must be eliminated in order to get only the calibration signal. */ 
eliminate, extraneous pixels(LowGroup) :- 

overtone group (LowGroup,LGList,OverGroup,OGList), 

cull. region. pixels(LowGroup,OGList), fail. 

eliminate extraneous, pixels (LowGroup). 

cull-region.pixels(G,.[]). 


cullsregicn pixels (GC, (Rilbist)) ;-' cull-region-pixels2T16 RIS 
cull_region_pixels(G,List). 

си! | region pixels2(G,R) == рахе YRD KES, KNC 
assertz (overtone pixel(X,Y,G,I)), fail. 

cull region pixels2(G:R) зе рахе у RAD), XC 5505200 585 


( 

) 

assertz(overtone pixel(X,Y,G,I)), fail. 

cull- region pixels? (G R]. 

/* Find out when the calibration signal begins and ends. */ 

get calibration params(Group) :- get overtone params (Group,Oymin,Oymax), 
get calibration ymin(Group,Oymin,Ymin), 

get calibration. ymax(Group,Oymax, Ymax), 

group(Group,Glist), assertz(calibration, signal (Group,Glist,Ymin,Ymax)). 
get overtone params (Group, Ymin,Ymax) :- 

bagof(Y, I^X^overtone pixel(X,Y,Group,I), Ylist), 

min(Ylist,Ymin), max(Ylist,Ymnax). 

get calibration ymin(Group,Oymin,Ymin) :- 

group. qualities (Group,Lxmin,Lxmax,Lymin,Lymax,Larea,Lloudness,Ldensity), 
Lymin « Oymin, Ymin is Lymin. 

get, calibration ymin(Group,Oymin,Ymin) :- Ymin is Oymin. 

get calibration, ymax(Group,Oymax,Ymax) :- 

group. qualities (Group,Lxmin,Lxmax,Lymin,Lymax,Larea,Lloudness,Ldensity), 
Lymax » Oymax, Ymax is Lymax. 

get calibration ymax(Group,Oymax,Ymax) :- Ymax is Oymax. 
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/* Process all groups to see if they might be earthquakes */ 

get earthquakes :- abolish(lastquakegensym/1), abolish(lastfarquakegensym/1), 
abolish(possible quake/3), abolish(far quake/2), 

get potential quakes(1), get far quakes(1), define far quakes(1), 

get, near, quakes. 

get, potential. quakes(Group) :- group(Group,Glist), get, potential, quakes2 (Group), 
NewGroup is Group *« 1, get, potential quakes(NewGroup). 

get potential, quakes(Group). 

get potential, quakes2 (Group) :- 

group qualities (Group, Xmin, Xmax, Ymin, Ymax,Area,Loudness,Density), 

Xmin « 10, Area » 5, 

not (calibration signal(Group,. , , )), group(Group,Glist),quakegensym(K), 
assertz(possible quake(K,Group,Glist)). 

get potential, quakes2 (Group). 


get far quakes(Quake) :- possible quake(Quake,Group,Glist), 

group. qualities (Group, Xmin, Xmax,Ymin,Ymax,Area,Loudness,Density), Xmax - 25, 
get far quakes2(Quake), NewQuake is Quake « 1, get far quakes(NewQuake). 

get far quakes(Quake) :- possible quake(Quake,Group,Glist), 

NewQuake is Quake « 1, get far quakes (NewQuake). 

get far quakes (Quake). 

get far quakes2(Quake) :- combine adjacent far quakes(Quake). 

get far quakes2(Quake) :- farquakegensym(K), assertz(far_quake(K, [Quake])). 
get near, quakes. 


combine adjacent far quakes (Quake) :- lastfarquakegensym(K), far quake(K,Qlist), 
Quakeml1 is Quake - 1, possible. quake(Quakemi,Groupml,. ), 

| member(Quakeml1,Qlist), possible. quake (Quake,Group,. ), 

| стошр наша 1 лес (сСгошр, ,„ ,Үпіп,Үпах, , , 1), 

group_qualities(Groupml CMA NIE pns 





7....ғ.. 


| adjacent, quakes (Ymin,Ymax, Ymaxml), 

| retract(far.quake(K,Qlist)), assertz(far.quake(K, [QuakelQlist])). 
| adjacent quakes(Ymin,Ymax,Ymaxml) :- 

Yaqui “is Ymaxml - Ymin, abs(Ydif,AbsYdif), AbsYdif < 9. 


adjacent, quakes(Ymin,Ymax,Ymaxml) :- Ymaxml > Ymax. 
define. far. quakes(Quake) :- far quake (Quake,Qlist), 
| get quake, regionlist(Qlist,[],Rlist), retract(far quake(Quake,Qlist)), 
| assertz(far quake(Quake,Rlist)), NewQuake is Quake + 1, 


| define far quakes (NewQuake). 
define far quakes(Quake). 
GEE GUake сеа топ ен ВЕЕ ЕЕ). 
get. quake. regionlist([QuakelQlist],[)],Rlist) :- 
possible quake(Quake,Group,Glist), get quake regionlist(Olist,Glist,Rlist). 
get quake regionlist(([QuakelQlist],Reglist,Rlist) :- 
possible quake(Quake,Group,Glist), 
append(Glist,Reglist,Newlist), get, quake. regionlist(Qlist,Newlist,Rlist). 


/* Assert facts for all groups that haven't been included in other types */ 
get unknowns :- abolish(lastunknowngensym/1), abolish(unknown group/3), 
get unknowns1(1). 

get unknownsl1 (Group) :- group(Group,Glist), 

group. qualities(Group, , ,., .,Area, ,.), Area » 7, not(whale, member (Group)), 
notí(possible quake member (Group)), not(overtone group, member(Group)), 
unknowngensym(K), assertz (unknown group(K,Group,Glist)), 

NewGroup is Group + 1, дес unknownsl(NewGroup). 

get_unknowns1 (Group) :- group(Group,Glist), NewGroup is Group + 1, 

get unknownsi1(NewGroup). 

get unknowns1 (Group). 


whale_member (Group) :- whale(_,Group,_). 
possible_quake_member (Group) :- possible_quake(_,Group,_). 
overtone_group_Member (Group) :~ overtone_group(_,_,Group,_). 
overtone_group_member (Group) :- overtone-group(Group,_,_,_ 


/* Find the angle of the best line fit through a group */ 
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/* Also find the mean distance and variation of the pixels in the group from */ 
/* the line. Also, find tne mean distance and variation of the intersection */ 
/* of the perpendicular to each pixel with the line. */ 


get unknown, group qualities :- abolish(best, line fit/6), 
get uk group qualities(1). 
get uk group qualities(Ugroup) :- unknown, group(Ugroup,Group,Glist), 


get uk group qualities2(Ugroup), NewGroup is Ugroup + 1, 

get uk, group qualities(NewGroup). 

get uk, group qualities (Џагоцр) . 

get uk group qualities2(Group) :- get center (Group, Xc, Yc), 

aseertz(best line-fat(Group,10.710,10.,29. 103), abolvsHoxdrst als 
abolish(xdistvariance/]), abolish(dist.to line/1); 

abolish(dist.to line variance/1),assertz(xdist(0)),assertz(xdistvariance(0))9 
aesertz(dist to l:ine(0)]),assertz(disbt-to* iHe хасталсе (017 

get uk group qualrities3(GEOUD.Xc.Yc 9090). 

best line FILIOEPOUDAmgle =, ee 
сес. uk » group. qualities3 (Group,Xc,Yc,Angle) :- Angle » 2.75. 
get uk, group qualities3(Group,Xc,Yc,Angle) :- 

get line eq(Xc,Yc,Angle,SinBeta,CosBeta,P),group(Group,Glist), 

get distances (Glist,Xc,Yc,SinBeta,CosBeta,P),get distances2 (Group), 

get best line fit(Group,Angle), NewAngle is Angle + 0.392699, 

get uk group qualities3 (Group, Xc,Yc,NewAngle). 
get distances((],Xc,Yc,SinBeta,CosBeta,P). 
get distances([RegionlGroup],Xc,Yc,SinBeta,CosBeta,P) :- pixel(X,Y,Region,.), 
DistToLine is X * CosBeta « Y * SinBeta - P, abs(DistToLine,AbsDistToLine), 
DistToLineSO 1e DistToLine * DsstToLine; xdaf IS CEL TOIL IS же, ње 
DistTOoOCenterSQ re Хоа ЕР кал! "> кали“ ударе, 

XdistSQ is DistToCenterSQ - DistToLineSQ, do sqrt (XdistSQ,Xdist), 
retractixdisti(oldXdist)j. NewXdisSt is OlaXdist хатзех 

assertz(xdist (NewXdist)), 

retract(xdistvariance(OldXdistSQ)), NewXdistSQ is OldXdistSQ « XdistSQ, 
assertz(xdistvariance(NewXdistSQ)) 

retract (dist. to_line(OldDistToLine)), 

NewDistToLine is OldDistToLine + AbsDistToLine, 
assertz(dist to line(NewDistToLine)), 

retract (dist. to line. variance (OldDistToLineSQ)), 

NewDistToLineSQ is OldDistToLineSQ « DistToLineSOQ, 
assertz(dist to line variance(NewDistToLineSQ)), 

га 
get distances([RegionlGroup],Xc,Yc,SinBeta,CosBeta,P) :- 

get distances (Group,Xc,Yc,SinBeta,CosBeta,P). 
get distances2(Group) :- group qualities(Group,. , , , „Агеа, , ), 
retract(xdist(OldXdist)), NewXdist is OldXdist / Area, 
assertz (xdist (NewXdist) ), 

retract (xdistvariance (OldXdistVar)), 
assertz(xdistvariance(NewXdistVar)), 
retract(dist to line(OldDistToLine)), NewDistToLine is OldDistToLine / Area, 
assertz(dist to line(NewDistToLine)), 
retract(dist to line variance(OldDTLV)), NewDTLV is Ol1dDTLV / Area, 
assertz(dist, to line variance(NewDTLV)). 
get best line fit(Group,NewAngle) :- 

best line fit(Group,Angle,Xdist,XdistVar,DistToLine,DistToLineVar), 

dist to line(NewDTL), NewDTL - DistToLine, 

xdist(NewXdist), xdistvariance(NewXDV), dist to line. variance(NewDTLV), 
retract (best_line_fit(Group, Angle, Xdist,XdistVar,DistToLine,DistToLineVar)), 
assertz(best line fit(Group,NewAngle,NewXdist,NewXDV,NewDTL, NewDTLV) ) . 

get best line. fit(Group,NewAngle). 

get line eq(Xc,Yc,Angle,SinBeta,CosBeta,P) :- acos(0,PiOver2), 

Beta is Angle « PiOver2, sin(Beta,SinBeta), cos(Beta,CosBeta), 

P is Xc * CosBeta + Yc * SinBeta. 


NewXdistVar is OldXdistVar / Area, 


docsgrt(xXdisetsOQO,Xdvst) :- Xdijsb5O » 0, ваге Кас ЕЕЕ асау 
docsgrtixdistSQ,xXdist) :- Xdist ie O0. 
get cenEer[(Group;Xorc) - groubpdioroubp.olisto азо ктеп [хошал ү 


abolish(ytotal/1), assertz(xtotal(0)),assertz(ytotal(0)), 
get_xytotals(Glist), group qualities (Croup: а 7) Area 7s 

хоса СХЕ) еса (УЕ "Xc 1898 ХЕ Улус оси ое сата! 

get xy totals((1]) 

get xy totals((RegionlGlist]) :- pixel(X,Y,Region,.),xtotal(Xt),ytotal( 1B 
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меше as XE + Х, МемтЕе зе Yt 4 Y, retract(xrotal(Xt)), retract(ytotal(Yt)), 
assertz(xtotal(NewXt)), assertz(ytotal(NewYt)), fail. 
get xy. totals((RegionlGlist]) :- get, xy. totals(Glist). 


/* Take unknown groups and find out if they might be associated with whales. */ 
get more whales :- get more whales1(1). 
get more whalesl(Wgroup) :- whale(Wgroup,Group,.), get, more whales2 (Group), 
NewWgroup is Wgroup »« 1, get more whales1(NewWgroup). 
get more whalesl(Wgroup). 
get more whales2(Wgroup) :- 

group. qualities (Wgroup,WXmin,WXmax,WYmin,WYmax,WArea,. , ), 

unknown, group (Ugroup,Group,Glist), 

group. qualities (Group,UXmin,UXmax,UYmin,UYmax,UArea,.,..), 

nearby whale(UXmin,WXmin,UXmax,WXmax,UYmin,WYmin,UYmax,WYmax), 

retract (unknown, group (Ugroup,Group,Glist)), 

assert (associated whale group (Ugroup,Group,Glist)), 

make whale group list (Wgroup,Group). 
get more whales2(Wgroup). 


/* Determine if an unknown sound is near enough to a whale sound to be called 
a part of the same sound. */ 

nearby whale(UXmin,WXmin,UXmax,WXmax,UYmin,WYmin,UYmax,WYmaXx) :- 

XminMaxDif is UXmin - WXmax, abs(XminMaxDif,AbsXminMaxDif), 

AbsXminMaxDif « 14, YminMaxDif is UYmin - WYmax, 
abs(YminMaxDif,AbsYminMaxDif), AbsYminMaxDif « 8. 

nearby. whale(UXmin,WXmin,UXmax,WXmax,UYmin,WYmin,UYmax,WYmax) :- 

XminMaxDif is WXmin - UXmax, abs(XminMaxDif,AbsXminMaxDif), 

AbsXminMaxDif < 14, YminMaxDif is WYmin - UYmax, 

abs (YminMaxDif,AbsYminMaxDif), AbsYminMaxDif < 8. 


/* Add to list of grouped groups of whales or create a new one */ 

make whale group list (Wgroup,Group) :- whale. group (WhaleGroup), 
member(Wgroup,WhaleGroup), retract(whale group(WhaleGroup)), 
append([Group],WhaleGroup,NewWhaleGroup), 

assert(whale group(NewWhaleGroup)). 

make whale group list(Wgroup,Group) :- assert (whale group((Wgroup,Group])). 


уа 

get more whalesl(Ugroup) :- unknown group(Ugroup,Group,Glist), 
guesupsqualltlies(Ugroup,Xmin,.,Ymin,Ymax,Area, ,.), Xmin » 10, 

max - Үшїп > 4, Агеа > 20, Area < 240, best.line fit(Ugroup,Angle, r;a); 
get, more whales2(Ugroup,Group,Angle), NewUgroup is Ugroup + 1, 

get more whalesl1(NewUgroup). 

get more whalesl(Ugroup) :- unknown group(Ugroup,Group,Glist), 
NewUgroup is Ugroup *« 1, get more whalesl(NewUgroup). 

get more whalesl(Ugroup). 

get more whales2(Ugroup,Group,Angle) :- Angle » 0.30, Angle « 1.2, 
whalegensym(K), group(Group,Glist), assertz (whale(K,Group,Glist)), 
retract (unknown, group (Ugroup,Group,Glist)), 

assertZz (unknown, group (Ugroup,0, [0]) ).. 

get more whales2(Ugroup,Group,Angle). 


i 

Ди 

get overlapping whales :- get overlapping whales1l(1). 

get overlapping. whalesl(Ugroup) :- unknown group (Ugroup,Group,Glist), 


Group > O,group-qualitjes(Ugroup,Xmin,-,Ymin,Ymax,Area, , .), 

Xmin » 10, Ymax - Ymin > 50, Area » 239, get overlapping whales2(Ugroup), 
NewUgroup is Ugroup » 1, get, overlapping whalesl(NewUgroup). 

get overlapping whalesl(Ugroup) :- unknown, group (Ugroup,Group,Glist), 
NewUgroup is Ugroup -« 1, get, more whalesi(NewUgroup). 

get overlapping. whalesl(Ugroup). 

get overlapping whales2(Ugroup) :- group(Ugroup,Glist), member(R,Glist), 
delete(R,Glist,NewGlist), 

a 
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/* Generates a new integer each time it is called */ 


whalegensym(K) :- retract(lastwhalegensym(Km1)), !, K is Кпт1+1, 
assertz(lastwhalegensym(K)). 

whalegensym(1) :- assertz(lastwhalegensym(1)). 

groupgensym(K) :- retract(lastgroupgensym(Km1)), !, K is Kmi+l1, 
assertz(lastgroupgensym(K)). 

groupgensym(1) :- assertz(lastgroupgensym(1)). 

quakegensym(K) :- retract (lastquakegensym(Km1)), !, K is Kml+1, 
assertz(lastquakegensym (K)). 

quakegensym(1) :- assertz(lastquakegensym(1)). 

farquakegensym(K) :- retract(lastfarquakegensym(Kml1)), !, K is Кт1+1, 
assertz(lastfarquakegensym(K)). 

farquakegensym(1) :- assertz(lastfarquakegensym(1)). 

unknowngensym(K) :- retract(lastunknowngensym(Km1)), !, K is Kml-«1l, 
assertz(lastunknowngensym(K)). 

unknowngensym(1) :- assertz(lastunknowngensym(1)). 

print results :- tellí(results), listing(group), listing(group^qualjityecdM 
liscing(unknown group), listing(best line fit), listing (horizontal IM 
listing (vertical_edge), listing(vertex), listing (calibration signals 
listing(overtone_region), listing(low_calibration_signal), 


listing(overtone group), listing(whale), listing(possible quake), 
Iieting(far quake), listonginumpixels), told: 


/* Write the regions of size > 5 to a file in lisp readable format. */ 


do lisp regions :- tell(lispfile), write pixel. group(1), told. 

write pixel group(G) :- group(G,Gllst), already written(G), бр is G+ 42 
write pixel grouptGpi). 

write pixel group(G) :- group(G,Glist), group.qualities(G,., ,.,.. дгеа, NP 
Area » 5, write('( '), group type(G,Type,NewGlist), write(Type), write(' '), 
write pixel group2(NewGlist), 

write(')'), Gpl1 is G 1, write pixel group(Gp1). 

write pixel. group(G) :- group(G,Glist), Gpl is G + 1, write pixel. group(Gpl1). 


write_pixel_group(G). 
write pixel, group2([]). 


write pixel. group2(([RegionlGlist]) :- write pixel. group3 (Region), 
write pixel group2(Glyst). 

write pixel. group3 (Region) :- pixel(Y,X,Region, ), write('('), 
чүге уу лыт е *39 wraite(Y); wrltet')w) nb. Баја 


write pixel, group3 (Region). 


/* Get the group type for a group and associate it with a letter. */ 


group type(Group,'w',NewGlist) :- whale( ,Group, ), whale group (WhaleGroup), 
member(Group,WhaleGroup), get whalegroup regions (WhaleGroup,[([],NewGlist). 
group. type(Group,'w',Glist) :- whale( ,Group,Glist). 


) 
group. type(Group,'u',Glist) :- unknown, group(. , Group,Glist). 
group type(Group,'q',Gli!st) :- possible quake(- Gboup,GllSE)- 
group-tyvpe(Group, 'o',Gll1st) :- group(GroupoGlrst3- 


/* Find all the regions that belong to one whale song and list them. */ 
get whalegroup regions((),WhaleList,WhaleList). 

get, whalegroup regions([GrouplGroupList],RegionList,WhaleList) :- 
group(Group,Rlist), 

append(Rlist,RegionList,NewRegionList), assert(already written(Group)), 
get whalegroup regions (GroupList,NewRegionList,WhaleList). 


/* END END END END END END END END END END END END END END */ 
/* SEEM SEEM SEEM SEEM SEEM SEEM SEEM SEEM SEEM SEEM SEEM SEEM SEEM SEEM */ 


ха Region "clumping" using the gradient-threshold array as input. */ 
/* This version more appropriate for sound processing. */ 


incrclump(Infile,Outfile) :- abolish(region name change/2), 
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abolish(lastrowegensym/1), abolish(final, code/2), 

see(Infile), tell(tempclumpfile), 

readlineclump(GL1), length(GL1,N), constant vector(*,N,CV), 
anepclumprow(CV,CV.GLl), 

see(tempclumpfile), tell(Outfile), 

abolish(lastrowegensym/1), fix region, names, seen, told. 
incrclumprow(RL1,GL1,GL2) :- 

at, end. of. file, 

iuncercdgumprow2(RLl.*.[*IGb1];[L*1GBb2];RL2), write.line(RLb2)., 
seen, told, !. 

incrclumprow(RL1,GL1,GL2) :- 

Iuercumbprow2(RLl *DU*IGhl];[I*T1Gb2].RLDb2); 

write line(RL2), readlineclump(GL3), incrclumprow(RL2,GL2,GL3). 
/* Reads the first pass output back in, changes the region names, writes out */ 


fix region names :- not(at end of file), readlineclump(L), 
fix region names(L,NL), write line(NL), !, fix region, names. 
fix region names :- abolish(region, name change/2), abolish(final, code/2). 
fix region names([],I[l). 
fix.region, names([*!L],I*INL]) :- !, fix region, names(L,NL), !. 
fix, region names([R1lL],[R21]NL]) :- transitive, region, name change (R1,R3), 
xfinal code(R3,R2), !, fix region names(L,NL), !. 
fix region, names([R1lL], [R2] NL]) :- xfinal. code(R1,R2), 
fix region names(L,NL), !. 
xinal code(R1,R2) :- final code(R1,R2), L. 
xfinal, code(R1,R2) :- rowegensym(R2), assertz(final, code(R1,R2)), !. 


/* Handles a single row during incremental clumping. */ 

/* First arg is region labels for previous row, second arg is region */ 

Ta bel Cor cell to the left ot the current cell, third arg is list */ 

ог 05 апа *s (gradient threshold output) for row above, fourth arg */ 

/* is same for current row, and fifth arg is output, the new region labels. */ 


ЖАС епсі от кома 77 

пее КОМОІТІ SJ LLI ге. 

/* Is this an edge cell? */ 

ЈИ та те соме (КЛЕ ] „2 [о 6121661] , [621, 1652) , [“ЈЕВБ2 ] ) :- 1; 

merc lüumprow2 (RL1,*, [G12 IGL1],; [*IGL2]1,RL2)- 

/* Start a new region if this cell is unconnected above and to left */ 
Mererump rows ((R11)RGL1),—, (,*'GL1).(*,G22)GL2), [KIRL2])} :=- 1, гоиедепсуп(к), 
irene lumprow2 (RL1,K;(*1Gb1] [G22 1GL2)],RL2) . 

/* Merge with region above if this cell is unconnected to left */ 

пиете ореол ШЕТТЕГІ,” / [ GI2TGL1];[*,G22|Gb2];,[RITIRE2]) :- !, 
iMmerclumprow2 (Ri1,R11,(G12|GL1),[G22|GL2}),RL2) . 

/* Merge with region left if this cell is unconnected above */ 
NEcscdumprow2 CDREEIRBLIZR20.[— *IGEbI].;[G21;,G22|Gb2];, [R201]RE2]) :- !, 
imere \Umprow2 (Ril, R20, *|GL1 |, (G2Z2|GL2],RL2). 

/* Else merge two regions through this cell; lower region number wins */ 
Wietelumprow2 (| RI1IRLI|,R20,(_,612|/GL1),(621,622!)GL2]., [RAIRL2]) :- 

not (R20-R11), sort2(R20,R11,RA,RB), not(region_name_change(RB,RA)), !, 
assertz (region_name_change(RB,RA)), 
imerclumprow2 (RL1,RA, | С12 16.11 „1222 |с1Ъ21|,в.2). 

/* Avoid merge if two regions meeting are same or are marked for merge */ 
TZncercdlnmprow2tlRlLIRBL1],R20.,[—,G12|GL1],[G21,G22]GL2], [RAI RE2]) :- !, 
SOREZ(BIIZR20,RA,RB),; incerclumprow2(RL1,RA,(G12|GL1],[G22]|GL2],RLE2). 


/* Region "clumping" using the gradient-threshold array as input, */ 
/* with merging across diagonals also permitted. */ 
/* This version more appropriate for sound processing. */ 


diagincrclump(Infile,Outfile) :- abolish(region. name, change/2), 
abolish(lastrowegensym/1), abolish(final, code/2), 
see(Infile), tell(tempclumpfile), 
readlineclump(GL1), asterisk buffer(GL1,XGL1), 
length(GL1,N), Np2 is N-*«2, constant vector(*,Np2,CV), 
diaginerclumprow(Cv,CV,xXGL1), 
see(tempclumpfile), tell (Outfile), 
abolish(lastrowegensym/1), fix_region_names, seen, told. 
diagincrclumprow(XRL1,XGL1,XGL2) :- at_end_of_file, 
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diagincrclumprow2 (XRL1,*,XGL1,XGL2,RL2), write line(RL2), seen, told, !. 
diagincrclumprow(XRL1,XGL1,XGL2) :- 

diagincrclumprow2 (XRL1,*,XGL1,XGL2,RL2), 

write line(RL2), readlineclump(GL3), 

asterisk, buffer(RL2,XRL2), asterisk buffer(GL3,XGL323), 
diagincrclumprow(XRL2,XGL2,XGL3). 

/* PUES asteriske at front and rear ot LIS my 

asterisk bufrer(b5b | ву ју = ар ел L LIES. 


/* Handles a single row during diagincremental clumping. */ 

/* First arg is region labels for previous row, second arg is region */ 

7“ label for cell to the lett of the currens cells океана кај тас, 

/* of 0s and *s (gradienrE threshold output) for'row above, fourth arden 

/* is same for current row, and fifth arg ls output, the new region labels TS 


/* At end of row? Ни 


ааб ПСЕ рО Е ж ы Ја ет (ЕГИ елш 
/* Is this an edge cell? */ 
diaginerclumprow2Z (2 Rilo, СЕ GI CLI eea AGL? T TARET E 


disdancrclumprow2 (RLI2*. [G12p0GDD ТЕЕ ЕБ) 

/* Start a new region if this cell is unconnected in all 4 directions */ 
diadginerclumprow2(0[L*.* *PRLIEILL S p*UGLPI I CE RESI Е 

г, rowegensym(K),. dragincrelumprow2t[*,*|REl].K GEI. GD2.RDb21: 

/* Merge adjacent regions through this cell; lowest region number wins */ 
diaginerclumprow2([Rll.RI2.RI3SURBII.B21.I- | GbID а | 1k | RL2 у ле 
әргсесі лцпрегссти ВА  КІЗ?БІЗСЕЗІІІІКІТЕРІЗ 

update neighbor. regions(K,KL), 
diagincrelumprow2([Rli2,Rl13IRBDI].K.GLl1.Gh2.RD2). 


diagincrclumprow2 (RL1,R21,GL1,GL2,RL2) :- told, seen, 
writet' Cannot clump Chis situation: je inl, 
write(IRLI. R21 GLI GLAT REZ ии се 


diagincrclumprow2 (RL1,R21,GL1,GL2,RL2). 


/* Returns the sorting of all numbers in a list of symbols */ 
sorted numbers, in(L,SL) :- setof(N,number member(N,L),NL), sort(NL,SL), !. 
number member(N,L) :- append( ,[NI. ],L), number(N). 
update. neighbor. regions(K,[l). 
update neighbor. regions(K,[K21]KL]) :- 

(region, name change(K2,K); assertz(region, name change(K2,K))), !, 

update neighbor. regions(K,KL). 


/* Function that returns the final region name to use after all merging */ 


transitive, region, name change(R,R) :- not(region name change(R,R2)), !. 
transitive. region name change(R1,R2) :- region name change(R1,R3), !, 
transitive region, name, change2 (R3,R2). 
transitive region. name, change2(R1,R2) :- region. name  change(R1,R3), 


transitive region name change2(R3,R2). 
transitive region. name change2(R,R) :- !. 


/* Modified region “clumping” using the intensities themselves; */ 

/* compares differences of adjacent cells to grow_threshold. */ 

/* Puts -10000 boundary around the whole picture. */ 

/* This version more appropriate for picture brightness processing. */ 


incrxclump(Infile,Outfile) :- abolishtregiononame-change72)]5 
abolish(lastrowegensym/1), abolish(final.code/2), 

see(Infile), tell(tempxclumpfile), 

readlineclump(GL1), length(GL1,N), constant, vector(-10000,N,CV), 
incrxclumprow(CV,CV,GL1), 

see(tempxclumpfile), tell(Outfile), 

abolish(lastrowegensym/1), fix region names, seen, told. 
inerxclumprowiRLbl.Gbl,Gb2).:- 

at end of file, 

incrxclumprow2 (RL1,-10000,([-100001GL1],(-10000|GL2], RL2), write. line(Rb20P 
seen, told, !. 

IDnerxclumprowilkbloGLI142Gb2)v:6 
incrxeclumprow2(Rbl,-10000,.|-10D09]GL1].1-190001GD2)] ЕЕ; 

write line(RL2), readlineclump(GL3), incrxclumprow(RL2,GL2,GL3). 
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/* Handles a single row during incremental x-clumping. */ 

/* First arg is region labels for previous row, second arg is region */ 
паре for cell to the left of the current cell, third arg is list */ 

/* of Os and *s (gradient threshold output) for row above, fourth arg */ 

/* is same for current row, and fifth arg is output, the new region labels. */ 


/* At end of row? */ 


uncrxolumprow2([jo— Е ке. 
/* Start a new region if this cell is unconnected above and to left */ 
aucrclumpFow2([RLLIRBEl];—-.[-,GI21GL1],[G21,G22|GL2]; FK IRE2]) = 


grow threshold(G), deviation(G22,G12,DY), DY»G, deviation(G22,G21,DX), DX»G, 
Іі, rowegensym(K), incrxclumprow2 (RL1,K,I[G121GL1],[G221GL2)],RL2). 
/* Merge with region above if this cell is unconnected to left */ 
incrxclumprow2([R11l|RL1],. ,(.,G121GL1)]), [G21,G221GL2] , [RI11RL2]) :- 

grow threshold(G), deviation(G22,G21,DX), DX»G, !, 
mnerxclumprow2(Rbl,R11;IGI2lGBEl],[G22[GL2],RLB2) . 
/* Merge with region left if this cell is unconnected above */ 
muxccumprow2([IRIIIRbli).R20,[—,G121Gbl1],1621,G221GL2], [R20IRL2]) :- 
grow threshold(G), deviation(G22,G12,DY), DY»G, !, 
incrxclumprow2(Rbl1,R20, [G121GL1).;-[G221GL2] , Rb2) . 
/* Else merge two regions through this cell; lower region number wins */ 
Nu erxciumprow2([RITIRLI]R20,[—,G121GL1]; [G21;G221|GLb2] ,[RAIREB2]) :- 

not (R20=R11), sort2(R20,R11,RA,RB), not(region_name_change(RB,RA)), !, 
assertz (region name change(RB,RA)), 

Au rxclumprow2(RbBl,RA,[GI21GL1];,[G22|GL2],RL2). 
/* Avoid merge if two regions meeting are same or are marked for merge */ 
amerxciumprow2i[RILIRBTI],R20,[—,GI2]GLI],[621,G221GDED2], IRAIRB2]) += t; 
SODL2(RITI,R20,RA,RB); incrxclumprow2(RLl,RA,[G12!GL1], [G22| Gh2] , Rb2) . 


/* Computes area, circumference, length and width of each region */ 
/* in an array of region codes. */ 


incrshapes(Infile,Outfile) :- 

abolish(area/2), abolish(circumference/2), abolish(xmax/2), 
abolish(xmin/2), abolish(ymax/2), abolish(ymin/2), 
mbolrshiwidth/2), abolish(height72), 

see(Infile), readlineclump(L1), readlineclump(L2), 

Menge ,N); constant, vector (*,;N,CV),; 

incrshapes2(1,CV,L1,L2), seen, 

tell(Outfile), listing(area), listing(circumference), 

Moure dimensions, listing (width), listing (height), toid. 
incrshapes2 (Row,L1,L2,L3) :- at_end_of_file, !, 

hescEh(th2,N); constant vector(*,N,CV), 
append(hl.*t]XLl),"append(b2,[1*],XL2), append(b3,[*),XL3); 
ANucDShspesj(Row.l1 Хр 2 1 ЈАВИ Је УД ХЪЗ)), Rowpl vis Row+l, 
шисжепаресз (Вомр1, 1, рез Хъ2), |, ІСУІ), 1: 
incrshapes2(Row,L1,L2,L3) :- append(L1,[*],XL1), аррепа (12, [*),Х12), 
asepengd(b3.[t] Xxb3).oxrxnershapes3(Row,l.E*UXLb2]. [p *bXbl],.T LU XEb3])), 
readlineclump(L4), Rowpl is Row«1, incrshapes2(Rowp1,L2,L3,L4). 
mer Shapes (Row, Colt УУТ 2). 

писе пареа Бом сол, тат а ОТТ Та Еј РЕЗЕ РА АЈ ЗА ое x, 
moulerscollcinershapes3(Row,Colpl-PF*I52].L1I12tb1],[1324|]b3])-. 
а= павее з Консот 2ЕтТ2 ТАА ТАЗ ПОА 11113. 121 И СтЗ а 2 13] = 
uninteresting region(I22), !, Colp1 is Со)41, 

шШрерг-пареззи вом, СОТр1, | 122, 1231121 „112 11, [1321503] )5 

шета паре во (ком Со, 1121; 122. 123402) I1 412 БЕ IIL З] у >, 
update area(I22), update circumference(122,121,112,123,132), 
üpdate-drmensions(I22,Row,Col), Colpl is Col*1, ', 

реше паре а (комуосео рта таз| ај [112] 5 T1, 1132153] ) 


updabesarea(R) == retract (area(R,N)), 4, Np1 is N+1, assertz(area(R,Npl)), 1. 
update_area(R) :- assertz(area(R,1)), !. 


update_circumference(R,R,R,R,R) :- !. 


update circumference(R, , , ,.) :- retract(circumference(R,N)), !, 
Npl is N«1, assertz(circumference(R,Np1)), !. 
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update circumference(R, , , ,.) :- assertz(circumference(R,1)), !. 


update dimensions(R,Row,Col) :- 

xmax(R, XH), Col=<XH, xmin(R, XL); Col>=XL, 
ymax(R,YH), Row=<YH, ymin(R,YL), Row>=YL, !. 
update_dimensions(R,Row,Col) :- 


retract. (.max(R, 4H) ) есас (аи Е)“ 

retract (ymax(R,YH)), retract(ymin(R,YL)), !, 
max(Col,XH,NXH), min(Col,XL,NXL), max(Row,YH,NYH), min(Row,YL,NYL), 
assertz(Xmax(R,NXH)), assertz(xmin(R,NXL)), 
assertz(ymax(R,NYH)), assertz(ymin(R,NYL)), !. 
update dimensions(R,Row,Col) :- 

assertz (xmax(R,Col)), assertz (xmin(R,Col)), 
assertz(ymax(R,Row)), assertz(ymin(R,Row)), !. 

figure dimensions :- xmax(R,XH), xmin(R,XL), DX is 1+XH-XL, 
ymax(R,YH), ymin(R,YL), DY is 1-*«YH-YL, 
assert2(width(R, DX)], assertz(heightik;DY))]), fall 


figure. dimensions. 


/* Converts a picture file to plxel(X,Y,Value) facts, writes them out 72 
/* All cells labelled "*" are ignored. */ 
pixel convert(Infile;Outfile) :- abolishí(pixel/3). 

see(Infile), pixel, convert2(1), seen, 

teliiOurfile), listing(pixel), told. 

pixel convert2(Row) :- not(at end of file), readlineclump(L), 

pixel  convert3(1,Row,L), Rowp1 is Row-«1, !, pixel convert2(Rowp1), !. 
pixel. convert2(Row). 

pixel. Converts (Col, Row, (Lib) )-:="(l]="*" = asserez (pixel (Cooly Row 1) ia 
Colpl te Coll, По pixel=cenvert31Celpl Row, је 
pixel_convert3 (Col, Row, ([]). 


/* Reads a file and correlates its entries with current pixel(X,Y,Value) */ 
/* facts, makes the value at the corresponding place in the input file */ 
/* to be the fourth argument to a “pixel” which it writes out. */ 

pixel. join(Infile,Outfile) :- 

see(Infile), tell(Outfile), pixel. join2(1), seen, told. 


pixel. join2(Row) :- not(at, end of. file), readlineclump(L), 

pixel join3(l1.Row,L), Rowpl те Row+1, 1; pikxelljoin2(Rowpl 1-2 

pixel, join2(Row). 

pixel joins (Col, how 0 :- pixel(Col;Row,.R). 1, 

writeq (prxeel (Col „Ком, Во Тју мере о 9. dms 

Colpl is Coll; !, pixel-joln3tfCoOlpl.Row.L)- 

pixel join3(Col;Row,[IIL]) :- Colpl is Col«l, 1, pixel Join: {Colpi T Ron OE 


pixel jólin? (Col Rów, []i. 


/* Converts a picture file to CLIPS form and writes out a new гајене 


clips. convert(Infile,Outfile) :- see(Infile), tell(Outfile), 
wrlte(’ (deftfacts incrvision |), nl. clips conmvert2(1); 
write(')'), seen, told. 

clips, convert2(Row) :- not(at, end, of. file), readlineclump(L), 


clips, convert3(1,Row,L), Комр1 is Row«1, clips convert2(Rowpl). 
clips.convert2(Row). 


clips, convert3(Col,Row,([*!L]) :- ',Сојр1 12 со1+1, clips_convert3(Colpl; kava 
clips. converkE3(Col,Row,[I|ib]) :- write(^(regron-index ), write(Ccol)s 
write(' "), wrlte(Row), write(^ '), write(I), write(")^), nl; 


Colpl is Col+1, clips convert3 (Colpi, Rw LI. 
clips convert3(cCol,Row,[]). 


ИУ ЛА РУСЕ ове и 


/* Some input routines. */ 

/* readlineclump(«list»)--reads a line from the terminal and */ 
/* clumps it into words, then binds 1ts argument to this list */ 
/* readline(<list>)--reads a line from the terminal and */ 

/* binds its argument to this as a character string */ 

/* niceread(<list>)--reads a line from the terminal and */ 

/* binds its argument to its ascii list representation */ 
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/* Note: This assumes that spaces, tabs, commas, colons, and */ 
/* semicolons separate words. If other symbols do too, */ 
/* add more "terminator" defintions. */ 


readlineclump(L) :- niceread(S), clumpstring(S,AL), makenames(AL,L), !. 
makenames([], []) 

такепатеѕ ( [ АШ 11 1, (NLINLL]}) :- name(NL,AL), makenames(LL,NLL) . 
pEunSstring(b3,[Bbi1|lb5]1) :--nextclump(Lb3,[];Ll1,b2); t;-clumpstring(L2,L5). 
Shampstring(L,(L}) := member(x,L), not (terminator(X)), !. 

с ишрсеетт по (1, 11). 

mexcelump(()],L1,RL1,([()) :- пос (1/1-(1); !, reverse(Ll,RL1l). 

dexet Tump ITIL], {1 L2, L3) += terminator(T), !, nextclump(L,l];L2,L3). 
nextclump([TIL],L1,RL1,L) :- terminator(T), !, reverse(L1,RL1). 

ee M XIL], L1, L2; L3) <= nextclump (L [XILI]; L2, L37. 

dE 

terminator ( 


2) 
WE rar 
bormindtor(58). 
terminator(59) 


readline(S) :- niceread(L), name(S,L). 
niceread([]) :- at. end of, file, !. 
niceread([]) :- at, end of line, getO(.), !. 
niceread((ACIlAL]) :- getO(AC), niceread(AL). 


constant vector(Symbol,O0,[]) :- ! 
constant _vector (Symbol, Length, [Symbol |List]) :- 
Lengthm1 is Length-1, constant vector(Symbol,Lengthml,List), !. 


SOFE2(N1,N2,N1,N2) :- NI«N2, !. 
SORERZUNI,N2,N2,N1) :- *. 


/* Generates a new integer each time it is called */ 


rowegensym(K) :- retract(lastrowegensym(Kml)), !, K is Kml-«l, 
asserta(lastrowegensym(K)). 
rowegensym(1) :- asserta(lastrowegensym(1)). 
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APPENDIX D: CLOS CODE FOR THE CORRELATION 
PROGRAM 


(defconstant *region-match-criterion* 0.4) 

(defmethod rb () 

(require :process) 

(let ((blackboardl (make-instance 'blackboard)) 

(Dlackboard2 (make-instance 'blackboard)) 

(picture (make-instance 'screen))) 

(initialize-blackboard blackboard1 'bonele 'bone2e O 3 'lower) 
(initialize-blackboard blackboard2 'bone3e 'bone4e 181 184 'upper) 
(Start-picture picture) 

(run-blackboard-r blackboardl1 picture) 

(run-blackboard-r blackboard2 picture) 

(match-far-phones blackboardi blackboard2 picture) 
)) 

(defmethod run-blackboard-r ((the-blackboard blackboard) (picture screen)) 
(with-slots (phonel phone2) the-blackboard 

(let ((new-region (gentemp)) listen-status) 

(set new-region (make-instance 'region)) 

(if (« (phone-time phonel) (phone-time phone2)) 

(let р) 

(setf listen-status (listen-to-hydrophone new-region phonel)) 
(unless listen-status 

(setf listen-status (listen-to-hydrophone new-region phone2)))) 
Tarmi) 

(setf listen-status (listen-to-hydrophone new-region phone2)) 
(unless listen-status 

(setf listen-status (listen-to-hydrophone new-region phonel))))) 
(when listen-status 

(process-new-region new-region the-blackboard picture) 

(if (» (- (possible-region-match-time the-blackboard) 
(last-definite-region-match-time the-blackboard)) 

(* 6 (allowable-time-difference the-blackboard))) 
(match-definite-regions the-blackboard picture)) 
(run-blackboard-r the-blackboard picture))))) 


(defmethod initialize-blackboard ((the-blackboard blackboard) phonei-filename 
phone2-filename phonel-latitude phone2-latitude screen-position) 
(with-slots (phonel phone2) the-blackboard 

(start-hydrophone phonel phonel-filename phonel-latitude screen-position) 
(start-hydrophone phone2 phone2-filename phone2-latitude screen-position) 
(setf (screen-position the-blackboard) screen-position) 

(setf (allowable-time-difference the-blackboard) 

(* (/ (abs (- (latitude phonel) (latitude phone2))) 0.81) 1.5)))) 

; Speed of sound (SOS) through water - 0.81 nm/sec 

;Slop factor for variation of SOS and phone separation is 1.5 

(defmethod process-new-region 

(new-region (the-blackboard blackboard) (picture screen)) 

(with-slots (phonel phone2 unmatched-regions) the-blackboard 


(if (equal (phone-id (eval new-region)) (phone-id phonel)) 
(setf (phone-time phonel) (time-min (eval new-region))) 
(setf (phone-time phone2) (time-min (eval new-region)))) 


(change-unmatched-to-unmatchable new-region the-blackboard picture) 
(match-new-region-to-unmatched-regions new-region the-blackboard picture) 
(match-new-region-to-tentative-matched-regions new-region the-blackboard 
picture) 

(unless (member-p new-region (possible-matched-regions the-blackboard)) 
(setf unmatched-regions (append unmatched-regions (list new-region))) 
(draw-region new-region the-blackboard picture 1)))) 
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(defmethod change-unmatched-to-unmatchable 

(new-region (the-blackboard blackboard) (picture screen)) 

(let ((unmatched-region-list (unmatched-regions the-blackboard))) 
(setf (unmatched-regions the-blackboard) 
(change-unmatched-to-unmatchable-r unmatched-region-list 
new-region the-blackboard picture) ))) 


(defmethod change-unmatched-to-unmatchable-r (unmatched-region-list new-region 
(the-blackboard blackboard) (picture screen)) 

(if unmatched-region-list 

(let ((tail (rest unmatched-region-list)) 

(head (first unmatched-region-list))) 

(if (or (equal (phone-id (eval new-region)) (phone-id (eval head))) 
(<= (- (time-min (eval new-region)) (time-max (eval head) ) ) 

КО ablo- time-difference the-blackboard))) 

(cons head 

(change-unmatched-to-unmatchable-r tail new-region the-blackboard 
рІсімте)) 

ШЕШЕ |) 

(setf (definite-unmatched-regions the-blackboard) 

(append (definite-unmatched-regions the-blackboard) 

(list head))) 

(draw-region head the-blackboard picture 2) 
(change-unmatched-to-unmatchable-r tail new-region 
the-blackboard picture)))))) 


(defmethod match-new-region-to-unmatched-regions 


(new-region (the-blackboard blackboard) (picture screen)) 

(let ((unmatched-region-list (unmatched-regions the-blackboard))) 
(setf (unmatched-regions the-blackboard) 
(match-new-region-to-unmatched-regions-r unmatched-region-list 
new-region the-blackboard picture)))) 


(defmethod match-new-region-to-unmatched-regions-r 


(unmatched-region-list new-region (the-blackboard blackboard) (picture screen)) 
(if unmatched-region-list 

(let ((tail (rest unmatched-region-list)) 

еза (first unmatched-region-list))) 

(if (equal (phone-id (eval new-region)) (phone-id (eval head))) 

nl head (match-new-region-to-unmatched-regions-r tail new-region 
the-blackboard picture) ) 

(let* ((region-match (match-region-factor new-region head 
(allowable-time-difference the-blackboard))) 
(region-matching-factor (first region-match))) 

(if (« region-matching-factor *region-match-criterion*) 

(cons head (match-new-region-to-unmatched-regions-r tail new-region 
the-blackboard picture) ) 

(let t) 

(adjust-blackboard-for-match new-region head region-match 
the-blackboard picture) 

(match-new-region-to-unmatched-regions-r tail new-region 


the-blackboard picture)))))))) 


(defmethod adjust-blackboard-for-match 


(new-region head region-match (the-blackboard blackboard) (picture screen)) 
(let ((region-match-factor (first region-match)) 

(match-dir (second region-match))) 

(unless (member (region-id (eval new-region)) 

(possible-matched-regions the-blackboard)) 

(setf (possible-matched-regions the-blackboard) 

(append (possible-matched-regions the-blackboard) (list new-region))) 
(draw-region new-region the-blackboard picture 3)) 

(setf (possible-matched-regions the-blackboard) 

(append (possible-matched-regions the-blackboard) (list head))) 

(let ((dir (direction new-region head match-dir (phonel the-blackboard) ) )) 
(setf (possible-region-matches the-blackboard) 

(append (possible-region-matches the-blackboard) 

(list (list new-region head region-match-factor dir))))) 
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(draw-region head the-blackboard picture 3) 
(connect-matched-region (list new-region head region-match- factor) 
picture (phone-id (eval new-region))) 

(setf (possible-region-match-time the-blackboard) 

(time-min (eval new-region))))) 


(defmethod match-new-region-to-tentative-matched-regions 
(new-region (the-blackboard blackboard) (picture screen) ) 

(let ((matched-region-list (possible-matched-regions the-blackboard))) 
(setf (possible-matched-regions the-blackboard) 
(natch-new-region-to-tentative-matched-regions-r matched-region-list 
new-region the-blackboard picture)))) 

(defmethod match-new-region-to-tentative-matched-regions-r 
(matched-region-list new-region (the-blackboard blackboard) (picture screen) ) 
(if matched-region-list 
(let ((tail (rest matched-region-list)) (head (first matched-region-list))) 
(if (or (equal (phone-id (eval new-region)) (phone-id (eval head))) 
(equal new-region head) 

(matched-member (list new-region head) 

(possible-region-matches the-blackboard) ) ) 

(cons head (match-new-region-to-tentative-matched-regions-r tail new-region 
the-blackboard picture) ) 

(let* ((region-match (match-region-factor new-region head 
(allowable-time-difference the-blackboard) ) ) 
(region-matching-factor (first region-match) )) 

(if (« region-matching-factor *region-match-criterion*) 

(cons head (match-new-region-to-tentative-matched-regions-r tail 
new-region the-blackboard picture) ) 

(let () 

(unless (member (region-id (eval new- region) ) 
(possible-matched-regions the-blackboard)) 

(setf tail (append tail (list new-region)))) 

(let ((dir (direction new-region head 

(second region-match) (phonel the-blackboard) ) )) 

(setf (possible-region-matches the-blackboard) 

(append (possible-region-matches the-blackboard) 

(list (list new-region head region-matching-factor 

Gig) и 
(draw-region new-region the-blackboard picture 3) 
(connect-matched-region 
(list new-region head region-matching-factor) 
picture (phone-id (eval new-region))) 

(setf (possible-region-match-time the-blackboard) 
(Cime-min (eval new-region))) 
(cons head (match-new-region-to-tentative-matched-regions-r 

tail new-region 
the-blackboard picture))])))2))]) 


(defmethod match-region-factor (regionl region2 allowable-time-difference) 


(let* (({blobl (eval regionl)) (blob2 (eval region2))) 
(if (< allowable-time-difference 

(abs (- (time-min blobl) (time-min blob2)))) 

OO) 


(overlap-factor blobl blob2)))) 
(defmethod matched-member (two-regions matched-list) 
(if matched-list 
(let ((head (first matched-list)) (tail (rest matched-list))) 
(if (and (equal (first two-regions) (first head)) 
(equal (second two-regions) (second head))) 

С 
(matched-member two-regions tail))))) 

(defmethod direction (regionl region2 offset (phonel hydrophone) ) 
(let ((tminl (time-min (eval regionl))) (tmin2 (time-min (eval region2)))) 
(if (equal (phone-id (eval regionl1)) (phone-id phonel)) 

б ЕГ ШЕШ ИЛЕШИП) 
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offset 

(- offset)) 

(А Сета | CminZ) 
(- offset) 
erreet)))) 


(defmethod area-factor 


((blobi region) (blob2 region) (the-blackboard blackboard)) 

(let (factor) 

(if (« (area blobl) (area blob2)) 

(setf factor (/ (area blob1) (area blob2))) 

gcotr factor (/ (area blob2) (area blobl)))) 

(let ((time-difference (abs (- (time-min blobl) (time-min blob2))))) 
(if (» time-difference (* 2 (allowable-time-difference the- б р з 
(setf factor 0) 

(Seti factor (/ factor (- 1 (/ (* 0.1 time-difference) 
(allowable-time-difference the-blackboard))))))) 

Море actor 11 

(Sel factor 1) 


шас сое) у) 


(defmethod overlap-factor 


((blobl region) (blob2 region)) 

(let ((overlap-value 0) overlap-index temp-overlap-value) 

(do ((index (+ 2 (abs (- (time-min blobi) (time-min blob2)))) 
((е index ( - (abs (- (time-min blobi) (time-min blob2))) 3)) 
overlap-value) 

(if (« (time-min blobi) (time-min blob2) ) 

(setf temp-overlap-value (overlap-region index blob1 blob2) ) 
(setf temp-overlap-value (overlap-region index blob2 blob1))) 
(when (> temp-overlap-value overlap-value) 

(setf overlap-value temp-overlap-value) 

(setf overlap-index index))) 
( 
(1 
( 
( 


(1- іпдех))) 


i overlap-index 

(< (time-min blobi) (time-min blob2)) 
Ee overlap-value overlap-index) 
list overlap-value (- overlap-index))) 
ШИТ) ) 


(defmethod overlap-region (time-diff (blobl region) (blob2 region) ) 


(let (time-adjusted-region) 

(setf time-adjusted-region (time-adjust time-diff (pixels blobl))) 

(let* ((overlap-area (overlap-pixels time-adjusted-region (pixels blob2)))) 
(/ (* 2 overlap-area) 

(* (length (pixels blobi)) (length (pixels blob2))))))) 


(defmethod time-adjust (time-diff pixels) 


"e че че Se Se ча за чо че 


(mapcar #’ (lambda (x) (list (+ (first x) time-diff) (second x))) pixels)) 


(defmethod overlap-pixels (pixel-seti pixel-set2) 
(if pixel-setl 

(if (pixel-member-p (first pixel-seti) pixel-set2) 
(append (list (first pixel-set1i)) 

(overlap-pixels (rest pixel-setl1) 

(remove (first pixel-set1) pixel-set2))) 
(overlap-pixels (rest pixel-seti1) pixel-set2)))) 


КО Оода overlap-pixels (region1 region2) 


(let ((overlap-value 0)) 

(if (« (length regioni) (length region2)) 
(dolist (pixel regioni overlap-value) 

(if (pixel-member-p pixel region2) 

(setf overlap-value (1+ overlap-value)))) 
(dolist (pixel region2 overlap-value) 

(if (pixel-member-p pixel regionl) 

(setf overlap-value (1+ overlap-value))))))) 


(defmethod pixel-member-p (item-list list-of-item-lists) 
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(if list-of-item-lists 
(let ((head (first list-of-item-lists)) (tail (rest list-of-item-lists))) 
(if (and (= (first item-list) (first head) ) 

( (second item-list) (second head))) 

С 
(pixel-member-p item-list tail))))) 

(defmethod min-freq-factor ((blobl region) (blob2 region)) 

(let ((freq-factor 
(- 1 (/ (abs (- (freq-min blob2) (freq-min blob1))) 64)))) 
(* freg-factor freg-factor))) 

;There are 64 Hz in the frequency band. 

(defmethod match-definite-regions ((the-blackboard blackboard) (picture screen)) 
(let ((head (first (possible-region-matches the-blackboard))) 
(tail (rest (possible-region-matches the-blackboard)))) 

(if head 
(match-definite-regions-r head tail the-blackboard picture)))) 

(defmethod match-definite-regions-r 
(possible-match possible-matched-list 
(the-blackboard blackboard) (picture screen)) 

(when possible-matched-list 

(if (check-time-frame-r possible-match the-blackboard) 

(let ((multiple-matches (find-multiple-matches-r possible-match 
possible-matched-list 

the-blackboard))) 

(if multiple-matches 
(perform-optimization-for-multiple-matches) 
(change-possible-match-to-definite possible-match 
the-blackboard picture)) 

(match-definite-regions-r (first possible-matched-list) 
(rest possible-matched-list) 

the-blackboard picture))))) 

(defmethod change-possible-match-to-definite 
(possible-match (the-blackboard blackboard) (picture screen)) 
(setf (possible-region-matches the-blackboard) 

(remove possible-match (possible-region-matches the-blackboard))) 

(setf (definite-region-matches the-blackboard) 

(append (list possible-match) (definite-region-matches the-blackboard))) 
(setf (possible-matched-regions the-blackboard) 

(remove (first possible-match) 

(possible-matched-regions the-blackboard))) 

(setf (possible-matched-regions the-blackboard) 

(remove (second possible-match) 

(possible-matched-regions the-blackboard))) 

(setf (definite-matched-regions the-blackboard) 

(append (definite-matched-regions the-blackboard) 

(list (first possible-match)))) 

(setf (definite-matched-regions the-blackboard) 

(append (definite-matched-regions the-blackboard) 

(list (second possible-match)))) 

(setf (last-definite-region-match-time the-blackboard) 

({time-min {eval (first possible-match)))) 

(draw-region (second possible-match) the-blackboard picture 4) 

(draw-region (first possible-match) the-blackboard picture 4)) 

(defmethod find-multiple-matches-r 
(matched-region region-matches (the-blackboard blackboard) ) 
(let ((head (first region-matches))) 

(if region-matches 

(if (region-in-common matched-region head) 
(when С 

(check-time-frame-r head the-blackboard) 
(cons head 

(find-multiple-matches-r matched-region (rest region-matches) 

the-blackboard)))) 
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(find-multiple-matches-r matched-region (rest region-matches) 
the-blackboard)))) 


(defmethod region-in-common (matched-regionl1 matched-region2) 
(if (member (first matched-regionl) matched-region2) 

(first matched-regionl) 

(if (member (second matched-regionl) matched-region2) 
(second matched-region2)))) 


(defmethod perform-optimization-for-multiple-matches () 
(print “Perform-optimization-for-multiple-matches is a stub")) 
(defmethod check-time-frame-r (possible-matched-region 
(the-blackboard blackboard)) 

(if (« (time-max (eval (first possible-matched-region))) 
(- (possible-region-match-time the-blackboard) 

(* 3 (allowable-time-difference the-blackboard)))) 

(if (« (time-max (eval (second possible-matched-region))) 
(- (possible-region-match-time the-blackboard) 

(* 3 (allowable-time-difference the-blackboard)))) 

E) 


(defclass blackboard () 

((phonel :accessor phonel 

:initform (make-instance ‘hydrophone) ) 

(phone2 :accessor phone2 

:initform (make-instance 'hydrophone)) 

(SCreen-position :accessor screen-position 

:initform 'lower) 

(unmatched-regions :accessor unmatched-regions 

ВИЛИ ОКТ 011) 

(possible-matched-regions :accessor possible-matched-regions 
ШИЕ гос па |) 

(possible-region-matches :accessor possible-region-matches 
znmwProrm nil) 

(possible-region-match-time :accessor possible-region-match-time 
ПЕЕ ГОТ 0) 

(definite-matched-regions :accessor definite-matched-regions 
DIL orm nil) 

(definite-region-matches :accessor definite-region-matches 

ANIC orm nil) 

(last-definite-region-match-time :accessor last-definite-region-match-time 
сее окт 0) 

(definite-unmatched-regions :accessor definite-unmatched-regions 
ІНІСІНЕ ОТІП nil) 

(allowable-time-difference :accessor allowable-time-difference))) 
(defclass blackboard-object () () ) 


(defclass hydrophone () 
ЕЕ 101 саго :file 
:accessor file) 
(blackboard-id :initarg ‘lower 
:accessor blackboard-id) 
(phone-id :initarg :phone-id 
:accessor phone-id) 
(latitude :initarg :latitude 
;:accessor latitude) 
(phone-time :initform O 
:accessor phone-time))) 


4 


(defclass region () 
((blackboard-id :initarg 'lower 
:accessor blackboard-id) 
(phone-id :initarg :phone-id 
:accessor phone-id) 

(region-id :initarg :region-id 
:accessor region-id) 
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(region-type :accessor region-type) 
(pixels :initarg :pixels 
:accessor pixels) 

(time-min :initarg :time-min 
:accessor time-min) 
(time-max :initarg :time-max 
:accessor time-max) 
(freq-min :initarg :freq-min 
:accessor freq-min) 
(freq-max :initarg :freq-max 
:accessor freq-max) 

(area :initarg :area 
:accessor area) )) 


(defclass unmatched-regions (region) 

((regron-list :Initform nil 

;accessor region-list))) 

(defmethod start-hydrophone ((phone hydrophone) filename input-latitude 

screen-position) 

(with-slots (file latitude phone-id blackboard-id) phone 

(setf file filename) 

(setf latitude input-latitude) 

(setf phone-id (gentemp) ) 

(setf blackboard-id screen-position) 

(setf file (open filename :direction :input)))) 

(defmethod listen-to-hydrophone (region-name (phone hydrophone) ) 
let ((blob (eval region-name) ) ) 


setf (phone-id blob) (phone-id phone) ) 
when (setf (pixels blob) (read (file phone) nil nil)) 
setf (blackboard-id blob) (blackboard-id phone) ) 


( 
( 
( 
setf (region-id blob) region-name) 
( 
( 


setf (region-type blob) (first (pixels blob))) 
pixels blob) (rest (pixels blob))) 
setf (time-min blob) (get-min-time (pixels blob) )) 
setf (time-max blob) (get-max-time (pixels blob) )) 
setf (freq-min blob) (get-min-freq (pixels blob) )) 
ша 


( 

( 
setf (freq-max blob) (get-max-freq (pixels blob 

(area blob) (length (pixels blob)))))) 
(defmethod get-min-time (pixel-list) 
(get-min-time-r (first (first pixel-list)) (rest pixel-list))) 


(defmethod get-min-time-r (temp-min pixel-list) 

(ТЕ first Баже е еј 

(let ((next-time (first (first pixel-list)))) 

(if (« temp-min next-time) 

(get-min-time-r temp-min (rest pixel-list)) 

(get-min-time-r next-time (rest pixel-list)))) 

temp-min) ) 

(defmethod get-max-time (pixel-list) 

(get-max-time-r (first (first pixel-list)) (rest pixel-list))) 
(defmethod get-max-time-r (temp-max pixel-list) 

(if (first pixel-list) 

(lec ((next-time (first (first pixel-list)))) 

(if (» temp-max next-time) 

(get-max-time-r temp-max (rest pixel-list)) 

(get-max-time-r next-time (rest pixel-list)))) 

temp-max) ) 

(defmethod get-min-freq (pixel-list) 

(get-min-freq-r (second (first pixel-list)) (rest pixel-list))) 
(defmethod get-min-freq-r (temp-min pixel-list) 

(lt rrsrobpe"Dixelb st) 
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(let ((next-freq (second (first pixel-list)))) 
(if (« temp-min next-freq) 

(get-min-freq-r temp-min (rest pixel-list)) 
(get-min-freq-r next-freq (rest pixel-list)))) 
temp-min)) 


(defmethod get-max-freq (pixel-list) 
(get-max-freq-r (second (first pixel-list)) (rest pixel-list))) 


(defmethod get-max-freq-r (temp-max pixel-list) 
(if (first pixel-list) 

(let ((next-freq (second (first pixel-list)))) 
(if (> temp-max next-freq) 

(get-max-freq-r temp-max (rest pixel-list)) 
(get-max-freq-r next-freq (rest pixel-list)))) 
temp-max) ) 


(defconstant *pixel-size* 1) 

(defvar *offset* (* *pixel-size* 64)) 
(defconstant *low* 60) 

(defconstant *high* 350) 


(defclass screen () 

((id :accessor id) 

(borders :initform 5 

:accessor borders) 

(Пе init orm O 

:accessor left) 

СООРО :ingytftorm 0 

:accessor bottom) 

(with -initform 1150 

:accessor width) 

iherght :initform 700 

:accessor height) 

(title :initform "Hydrophone Region Matches" 
:accessor title) 

(activate-p :initform t 

:accessor activate-p) 

(lower-y-text-position :accessor lower-y-text-position 
mle corm 1000) 

(upper-y-text-position :initform 1000 
saccessor upper-y-text-position) )) 


(defmethod start-picture ((picture screen) ) 

(require :xcw) 

(cw: initialize-common-windows) 

(setf (id picture) (cw:make-window-stream :borders (borders picture) 
delt lefte picture) 

:bottom (bottom picture) 

:width (width picture) 

:height (height picture) 

:title (title picture) 

:activate-p (activate-p picture))) 


(setf (cw:window-stream-extent-width (id picture)) (* 2 (width picture))) 


(cw:enable-window-stream-extent-scrolling (id picture) :vertical nil 
:horizontal t) 

(draw-y-scale picture) 

(draw-time-line picture)) 


(defmethod draw-y-scale ((picture screen)) 

(cw:draw-line-xy (id picture) O *low* (* 2 (width picture)) *1low*) 
(cw:draw-line-xy (id picture) 0 (+ *low* (* *pixel-size* 64)) 

eom widtrhopreture))(t *10w* (* *pixel-sS12ze* 64))) 
(cw:draw-line-xy (id picture) O (»* *low* (* *pixel-size* 128)) 
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(*-2 (width picture)) (+ "1ом“ (FF хезерге 128770 
(cw:draw-line-xy (id picture) O *high* (* 2 (width picture)) *high*) 
(cw:draw-line-xy (id picture) O (ч *high* (* *pixel-size* 64)) 


(*-2 (width picture)]) (4 *high* (* *pirxel-size* 64))) 
(cw:draw-line-xy (id picture) O (« *high* (* *pixel-size* 128)) 
(* 2ctwa3dth pacbure)) (- *bagh*-(* *Dyxel-s)2e5571289)95) 


(defmethod draw-time-line ((picture screen)) 
(do ((time-step O (- (* *pixel-size* 60) time-step))) 


((> time-step (* 2 (widtb picture)]) nil) 
(cw:draw-line-xy (id picture) time-step *high* time-step (- *high* 3)) 
(cw:draw-line-xy (id picture) time-step *low* time-step (- *low* 2)))) 


(defmethod paint-picture ((picture screen) (the-blackboard blackboard) ) 
(draw-regions-r (definite-unmatched-regions the-blackboard) the-blackboard 
picture 2) 

(draw-regions-r (possible-matched-regions the-blackboard) the-blackboard 
picture, 3) 

(draw-regions-r (unmatched-regions the-blackboard) the-blackboard 
picture) 

(connect-matched-regions-r (possible-region-matches the-blackboard) 
picture (phone-id (phonel the-blackboard)))) 


(defmethod draw-regions-r 

(region-list (the-blackboard blackboard) (picture screen) shade) 
(when region-list 

(draw-region (first region-list) the-blackboard picture shade) 
(draw-regions-r (rest region-list) the-blackboard picture shade) ) ) 
(defmethod draw-region 

(region (the-blackboard blackboard) (picture screen) shade) 
(with-slots (phonel phone2) the-blackboard 

(let* ((blob (eval region)) (screen-position (blackboard-id (eval blob))) 
offset) 

(if (equal screen-position ‘ lower) 

(cati ortfser *lgw't 

(setf offset *high*)) 

(identify-region (id picture) region offset 

(phone-id blob) (phone-id phone2)) 

(draw-pixels (id picture) (pixels blob) shade offset 

(phone-id blob) (phone-id phone2))))) 


(defmethod draw-pixels 

(picture-id pixel-list shade offset phone-id phone2-id) 
(dolist (pixel pixel-list t) ; 
(let ((time (* *pixel-size* (first pixel))) 

(freq (* *pixel-size* (second pixel)))) 

(if (equal phone-id phone2-id) 

(setf freq (+ "о зе“ freq))) 

(setf freq (+ freq offset)) 

(if (= shade 1) 

(cw:draw-filled-rectangle-xy picture-id time freq 
*pixel-size* *pixel-size* :color cw:black) 

(1Е (е впайе 2) 

(cw:draw-filled-rectangle-xy picture-id time freq 
*pixel-size* *pixel-size* :color cw:black) 

(if (= shade 3) 

(cw:draw-filled-rectangle-xy picture-id time freq 
*pixel-size* *pixel-size* :color cw: red) 

(it (= shade 4) 

(cw:draw-filled-rectangle-xy picture-id time freq 
*pixel-size* *pixel-size* :color cw:blue) 
(cw:draw-filled-rectangle-xy picture-id time freq 
*pixel-size* *pixel-size*)))))))) 

(defmethod identify-region (picture-id region offset phone-id phone2-id) 
(let ((x (* *pixel-size* (time-max (eval region)))) 
(У (* *pixel-size* (freq-max (eval region))))) 
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(if (equal (blackboard-id (eval region)) 'lower) 

(cott offset *low*) 

(sett offset *high*)) 

(setf y (^ y offset)) 

(if (equal phone-id phone2-id) 

(сег у (+ y *offset*))) 

(setf (cw:window-stream-x-position picture-id) х ) 
(setf (cw:window-stream-y-position picture-id) (+ y 4)) 
(format picture-id "-a" (region-type (eval region))))) 


(defmethod connect-matched-regions-r (region-matches (picture screen) phonel-id) 


(when region-matches 
(connect-matched-region (first region-matches) picture phonel-id) 
(connect-matched-regions-r (rest region-matches) picture phonel-id))) 


(defmethod connect-matched-region (region-match (picture screen) phonel-id) 


. 
, 


(let* ((regionl (first region-match)) (region2 (second region-match) ) 
(pixell (middle (pixels (eval regionl)))) 

(pixel2 (middle (pixels (eval region2)))) 

(x1 = *pixel=size* (first pixell))) 

(x2 (* *pixel-size* (first pixel2))) 

(yl (* *pixel-size* (second pixell))) 

(y2 (* *pixel-size* (second pixel2))) offset) 

(if (equal (blackboard-id (eval regionl)) ‘ lower) 

(setf offset *low*) 

(гес offset *high*) } 

(setf yl (+ yl offset) ) 

(seem y2 (+ y2 offset) ) 

(if (equal (phone-id (eval regionl)) phonel-id) 

(cw:draw-line-xy (id picture) xl yl x2 (+ *offset* y2)) 
(cw:draw-line-xy (id picture) xl (+ *offset* yl) x2 y2)) 

(if (equal (phone-id (eval regionl)) phonel-id) 
(setf (cw:window-stream-x-position (id picture)) x2) 
(setf (cw:window-stream-x-position (id picture)) x1)) 
(setf (cw:window-stream-y-position (id picture)) 
(set-y-text-position picture region1)) 

(format (id picture) “~d” (time-min (eval regionl1))) 


)) 
(format (id picture) "-3,2f" (third region-match)))) 


(defmethod set-y-text-position ((picture screen) region-name) 


(if (equal (blackboard-id (eval region-name)) 'lower) 
(if ( » (lower-y-text-position picture) 40) 

(setf (lower-y-text-position picture) 2) 

(setf (lower-y-text-position picture) 
(* (lower-y-text-position picture) 15)) 
(if ( » (upper-y-text-position picture) 
(+ *high* (+ 55 (* *pixel-size* 128)))) 
(setf (upper-y-text-position picture) 
(setf (upper-y-text-position picture) 
(+ (upper-y-text-position picture) 15))))) 


) 


(+ *high* 15 (* *pixel-size* 128))) 


(defmethod draw-match-list (matched-list 


(blackboard1 blackboard) (blackboard2 blackboard) (picture screen) ) 
(dolist (matched-list-1 matched-list nil) 

(let ((matched-pair-1 (first matched-list-1)) pixell xl yl) 

(if (equal (blackboard-id (eval (first matched-pair-1))) ‘lower) 
(if (equal (screen-position blackboardl) ‘lower) 

(if (equal (phone-id (eval (first matched-pair-1))) 

(phone-id (phonel blackboard1))) 

(Тест) 

(setf pixell (middle (pixels (eval (second matched-pair-1))))) 
(setf x1 (* *pixel-size* (first pixell))) 

СРЕМ yl (+ (* *pixel-size* (second pixell1)) *low* *offset*))) 
шег) 

(setf pixell (middle (pixels (eval (first matched-pair-1))))) 
Sel рахе сіе (first pixell))) 
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(sett yl (+.(* *pixel-size*. (second pixell)) *low* *offset*}))) 
(if (equal (phone-id (eval (first matched-pair-1))) 

(phone-id (phonel blackboard?) ) ) 

(let () 

(setf pixell (middle (pixels (eval (second matched-pair-1))))) 
(Sect x1. (* “pixel-size* (first prxeblny 

(setf yl (+ (* *pixel-size* (second pixell)) *low* *offset*))) 
(Лес 4) 

(setf pixell (middle (pixels (eval (first matched-pair-1))))) 
(SST xl (< *pixel-s12e* (f1rst DIXxell1))) 

(csetf v] (4 (* *pDrixel-size* (Second pixell)) *low* но сеци 
(ево 

(if (equal (phone-id (eval (first matched-pair-1))) 

(phone-id (phonel blackboardl))) 

(lee) 

(setf pixell (middle (pixels (eval (first matched-pair-1)))})) 
(setf Xl (* *plxel-size* {first pixell))) 

(setf yl (+ (* *pixel-size* (second pixell)) *high*})) 

(let () 

(setf pixell (middle (pixels (eval (second matched-pair-1))))) 
(Setf xl (* *pixel-size* (first pixell))) 

(setf yl (+ (* *pixel-size* (second pixell)) *high*)))) 

(if (equal (phone-id (eval (first matched-pair-1))) 

(phone-id (phonel blackboard2))) 

(let () 

(setf pixell (middle (pixels (eval (first matched-pair-1))))) 
(setf x1 (* *pixel-size* (first pixell))) 

(sett yl (+ (* *pixel-size* (second pixell)) *Bhigh*))) 

(керү) 

(setf pixell (middle (pixels (eval (second matched-pair-1))))) 
(setf x1 (* *pixel-size* (first ріхе11))) 

(cetf vl (« (* *pixel-siZe* (second pixell)). *high*)))933) 
(dolist (matched-list-2 (rest matched-list-1) nil) 

(dolist (matched-pair-2 matched-list-2 nil) 

; (let ((matched-pair-2 (first matched-list-2))) 

(when (» (first (first matched-pair-2)) 0.5) 

(lett ('plxel2 “middle 

(pixels (eval (first (second matched-pair-2)))))) 

(x2 |“ *pDixel-si2ze* (first pixel2))) 

(y2 (* *pixel-size* (second pixel2)))) 

(if (equal (blackboard-id (eval (first (second matched-pair-2)))) 
'^ lower) 

(setf y2 (* y2 *low*)) 

(Seti yo (4 y2 *hachs)):) 

(if (equal (blackboard-id (eval (first (second matched-pair-2)))) 
‘ lower) 

(seti y2 (F y2 кој сет, 

(cw:draw-line-xy (id picture) x1 y1 х2 у2)))))))) 


(defmethod draw-best-match-list (matched-list 


(blackboard1l blackboard) (blackboard2 blackboard) (picture screen) ) 
(dolist (matched-list-1 matched-list nil) 

(let ((matched-pair-1 (first matched-list-1)) pixell xl yl) 

(if (equal (blackboard-id (eval (first matched-pair-1))) ‘lower) 
(if (equal (screen-position blackboard1) 'lower) 

(if (equal (phone-id (eval (first matched-pair-1))) 

(phone-id (phonel blackboardl1))) 

(let () 

(setf pixell (middle (pixels (eval (second matched-pair-1))))) 
(sett xi [* *pixel-size* (first pixell)}) 

(secl yl {+ (* *plxel-size* (second pixell)) *low*=ofiset*))) 
(let () 

(setf pixell (middle (pixels (eval (first matched-pair-1))))) 
(бес зе 45 “*pixel=size* (first. pixel lj) 

(setf yl (+ (* *pixel-size* (second pixell)) *low* *offset*)))) 
(if (equal (phone-id (eval (first matched-pair-1))) 

(phone-id (phonel blackboard2) ) ) 

(let () 
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(setf pixell (middle (pixels (eval (second matched-pair-1))))) 
(setf x1 (* *pixel-size* (first pixell))) 
(sett yl (+ (*-*pixel-size* [second pixell)) *low* *offset*))) 
(шев () 
(setf pixell (middle (pixels (eval (first matched-pair-1))))) 
(sett x1 (* *pixel—-size* (first pixel1))) 
(setf yl (+ (* *pixel-size* (second pixell)) *low* *offset*))))) 
тее () 
(if (equal (phone-id (eval (first matched-pair-1))) 
EL id (phonel blackboard1))) 
(Tet {) 
(setf pixell (middle (pixels (eval (first matched-pair-1))))) 
Ocetf xl (* *pixel-size* (first pixell))) 
ПӘБЕС У1 (: (% *pixel-size* (second pixell)) *high*) )) 
(let () 
(setf pixell (middle (pixels (eval (second matched-pair-1))))) 
(setf x1 (* *pixel-size* (first pixell))) 
ET y1 (4 (* *pixel-size* (second pixell)) *high*)))) 
(if (equal (phone-id (eval (first matched-pair-1))) 
Ке id (phonel blackboard2) )) 
(let () 
(setf pixell (middle (pixels (eval (first matched-pair-1))))) 
(sett x1 (* *pixel-size* (first pixell))) 
feetr yl i(+ (* *pixel=size* (second pixell)). *high*))) 
"ret t) 
(setf pixell (middle (pixels (eval (second matched-pair-1))))) 
(setf x1 (* *pixel-size* (first pixell))) 
(setf yl (+ (* *pixel-size* (second pixell)) *high*)))))) 
; (dolist (matched-list-2 (rest matched-list-1) nil) 
; (dolist (matched-pair-2 matched-list-2 nil) 
(let ((matched-pair-2 (second matched-list-1))) 
x when (> (first (first matehed-pair-2)) 0.5) 
(let* ((pixel2 (middle 
Eel (eval (first matched-pair-2))))) 
Пен“ *pjxel-sSize* (first pixel2))) 
(y2 (* *pixel-size* (second pixel2)))) 
s (equal (blackboard-id (eval (first matched-pair-2))) 
lower) 
(seer y2 (+ y2 *low*)) 
еве (+ y2 лан“) ).) 
(if (equal (blackboard-id (eval (first matched-pair-2))) 
‘ lower) 
(setf y2 (+ y2 *offset*))) 
(cw:draw-line-xy (id picture) xl yl x2 y2)))))) 


(defconstant SLICES 20) 
(deteonstcant ‘far threshold 0.15) 


(defmethod match-far-phones 

((blackboard1 blackboard) (blackboard2 blackboard) (picture screen)) 
(let ((match-listl nil) (match-list2 nil) (best-match-list nil) 
(hough-list nil) (new-match-list1 nil) (new-match-list2 nil) 
(allowable-time-difference 

(* (/ (abs (- (latitude (phonel blackboardl)) 

(latitude (phene2 blackboard2) )))}) 0.81) 1.2))) 

(dolist (matched-pair (definite-region-matches blackboard1) nil) 
(setf match-listl 

(append (list (list matched-pair 

(match-far-regions allowable-time-difference 

matched-pair blackboard2) ) ) 

mMatch-listl1))) 

(dolist (matched-pair (definite-region-matches blackboard2) nil) 
(setf match-list2 

(append (list (list matched-pair 

(match-far-regions allowable-time-difference 
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matched-pair blackboardl))) 

match-list2))) 

(print "MATCH-LIST1") (print match-list1) 

(print "MATCH-LIST2") (print match-list2) 

(setf hough-list (get-hough-transform allowable-time-difference 
match-listl match-list2) ) 

(setf new-match-listl (apply-hough-list allowable-time-difference 1 
hough-list match-list1)) 

; (print "MATCH-LIST1 after HOUGH") (print new-match-list1) 

(setf new-match-list2 (apply-hough-list allowable-time-difference -1 
hough-list match-list2)) 

; (print “MATCH-LIST2 after HOUGH") (print new-match-list2) 

(сесі best-match-list (get-best-matches new-match-listi1 new-match-list2)) 
(draw-best-match-list best-match-list blackboard1 blackboard2 picture) 
(dolist (matched-pair best-match-list nil) 

(setf match-listl (remove-main-match (first matched-pair) match-list1)) 
(setf match-list2 (remove-main-match (second matched-pair) match-list2))) 
(dolist (matched-pair best-match-list nil) 

(setf match-list2 (remove-matched-pair (first matched-pair) match-list2) ) 
(setf match-listl (remove-matched-pair (second matched-pair) match-listl))) 
(print "MATCH-LIST1 AFTER REMOVAL") (print match-list1i) 

(print "MATCH-LIST2 AFTER REMOVAL") (print match-list2) 

(setf hough-list (get-hough-transform allowable-time-difference 
match-listl match-list2)) 

(setf new-match-listl (apply-hough-list allowable-time-difference 1 
hough-list match-list1)) 

(setf new-match-list2 (apply-hough-list allowable-time-difference -1 
hough-list match-list2)) 

(setf best-match-list (append best-match-list 

(get-best-matches new-match-listl1 new-match-list2))) 
(draw-best-match-list best-match-list blackboard1 blackboard2 picture) 
(print “BEST-MATCH-LIST”) (print best-match-list) 

(dolist (matched-pair best-match-list nil) 

(setf match-listl (remove-main-match (first matched-pair) match-listl) ) 
(setf match-list2 (remove-main-match (second matched-pair) match-list2))) 
(dolist (matched-pair best-match-list nil) 

(setf match-list2 (remove-matched-pair (first matched-pair) match-list2) ) 
(setf match-listl (remove-matched-pair (second matched-pair) match-list1))) 
(print "MATCH-LIST1 AFTER SECOND REMOVAL") (print match-list1) 

(print "MATCH-LIST2 AFTER SECOND REMOVAL") (print match-list2) 
) 

(draw-match-list match-listi blackboard1 blackboard2 picture))) 


defmethod match-far-regions 

(allowable-time-difference matched-pair-1 (the-blackboard blackboard)) 
(let ((region-1 (if (» (area (eval (first matched-pair-1))) 

(area (eval (second matched-pair-1)))) 

(first matched-pair-1) 

(second matched-pair-1))) 

(list-of-matches nil)) 

(dolist (matched-pair-2 (definite-region-matches the-blackboard) nil) 
(let* ((region-2 (if (» (area (eval (first matched-pair-2))) 

(area (eval (second matched-pair-2)))) 

(first matched-pair-2) 

(second matched-pair-2))) 

(match-factor (match-region-factor 

region-1 region-2 allowable-time-difference))) 

(if (» tfirstonatcen-factor) O) 

(setf list-of-matches 

(append (list (list match-factor matched-pair-2)) 
list-of-matches))))) 

(if list-of-matches 

(bubble-sort list-of-matches)))) 


; The Common Lisp Companion pg. 378 
(defmethod bubble-sort (input-list) 


(let (done) 
(MOOD 
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f 


аш done t) 

(do ((to-do input-list (rest to-do))) 
клы (length to-do) 1)) 

ІШПЕ (5 (ГІТЗс (Еттев (TITSE to-do))) 
(те (first (second to-do)))) 
(swap-elements 0 1 to-do) 

(seti done nil))) 

fitedone (return input-list))))) 


: The Common Lisp Companion pg. 376 


(defmethod swap-elements (n m input-list) 


(let ((nth-value (nth n input-list))) 

(setf (nth n input-list) (nth m input-list)) 
(setf (nth m input-list) nth-value) 
input-list)) 


(defmethod get-hough-transform 


(allowable-time-difference match-listi match-list2) 
(let ((hough-list nil) (minimum 1000) (maximum 0) 
(time-slice (* (/ allowable-time-difference SLICES) 2.0)) 
offset (/ SLICES 2.0))) 
dotimes (index SLICES nil) (setf hough-list (append ‘(0) hough-list))) 
ER (best-match-list match-listl nil) 
(first (second best-match-list) ) 
i ПРУ Оре ас ке (first (second best-match- lisci) 0-5) 
let ((index (floor (+ offset 
(/ (second (first (first (second best-match-list)))) 
time-slice))))) 
(if (« index O) (setf index 0)) 
(setf£ (nth index hough-list) 
I" irst (first (first (second best-match-list)))) 
(nth index hough-list)))))) 
(if (second (second best-match-list)) 
aM first (first (Second (second best-match-list)))) 0.5) 
(let ((index (floor (+ offset 
(/ (second (first (second (second best-match-list)))) 
time-slice))))) 
(if (< index 0) (setf index 0)) 
(гесЕ (nth index hough-list) 
(+ (first (first (second (second best-match-list)))) 
(nth index hough-list)))))) 
(if (third (second best-match-list)) 


( 
( 
( 
(1 
( 
( 


Pae (first (first (third (second best-match-list)))) 0.5) 
(let ((index (floor (+ offset 
(/ (second (first (third (second best-match-list)))) 


time-slice) )))) 

Ш (< index 0) (sett index 0) ) 

(setf (nth index hough-list) 

(+ (first (first (third (second best-match-list)))) 
(mebeindex hough-list)}))))) 

(dolist (best-match-list match-list2 nil) 

(if (first (second best-match-list) ) 

биро {(firet “(first (first (second best-match-Jist)))) 0.5) 
(let ((index (floor (+ offset (* -1.0 

(/ (second (first (first (second best-match-list)))) 
time-slice)))))) 

(if (« index O) (setf index 0)) 

(setf (nth index hough-list) 

(+ (first (first (first (second best-match-list)))) 
(nth index hough-list)))))) 

(if (second (second best-match-list) ) 

(iris (first ТЕігег (second (second best-match-list)))) 0.5) 
(let ((index (floor (+ offset (* -1.0 

(/ (second (first (second (second best-match-list)))) 
time-slice)))))) 

(if (« index O) (setf index 0)) 

(setf (nth index hough-list) 

(+ (first (first (second (second best-match-list)))) 
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h index hough-list)))))) 
(third (second best-match-list)) 
(- (first (first (third (second best-match-list))))"055) 
e (index (floor (« offset (*.-1.0 
(/ (second (first (third (second best-match-list)))) 
time-slice)))))) 
(if (« index O) (setf index 0)) 
(setf (nth index hough-list) 
(рате СЕЕ (third (second best-mabch-:l2st]9)») 
(nth index hough-list))))))) 
(dolist (element hough-list nil) 
(if (« element minimum) (setf minimum element))) 
(setf hough-list (mapcar #’ (lambda (x) (- x minimum)) hough-list)) 
(setf hough-list (mapcar #’ (lambda (x) (sqrt x)) hough-list)) 
(dolist (element hough-list nil) 
£r (» element maximum) (setf maximum element))) 
(1 
( 


F^ Fh (T 


(» maximum 0.0) 
А hough-list (mapcar #’(lambda (x) (double-float 
(/ x maximum))) hough-list))) 
(print ^HOUGH-LIST*) 
(print hough-list) 
hough-list) ) 


(defmethod apply-hough-list 

(allowable-time-difference direction hough-list match-list) 
(let ((time-slice (* (/ allowable-time-difference SLICES) 2.0)) 
(offset (/ SLICES 2.0)) (new-match-list nil)) 

(dolist (sub-match-list match-list new-match-list) 

(setf new-match-list 

(append new-match-list 

(list tlist (first sub-match-li3st) 

(apply-hough-list2 (rest sub-match-list) 

direction time-slice offset hough-list)))))))) 


(defmethod apply-hough-list2 

(sub-sub-match-list direction time-slice offset hough-list) 

(let ((new-list nil)) 

(dolist (match-element (first sub-sub-match-list) new-list) 

(setf new-list 

(append new-list (list (list (apply-hough-list3 (first match-element) 
direction time-slice offset hough-list) 

(second match-element)))))) 

(if new-list (setf new-list (bubble-sort new-list))))) 


(defmethod apply-hough-list3 

(list-element direction time-slice offset hough-list) 
(Jet tlindex (floor (+ offset {* direction 

e (second list-element) time-slice)))))) 

(If (»2s index SLICES) (Seti index (1- SBICES))) 

(if (= index 0) (setf rndex 097) 

ane (* (first list-element) (nth index hough-list)) 
(second list-element)))) 


коке get-best-matches (match-listl1 match-list2) 
(let ((best-match-list nil) match-list-1 match-list-2) 
(secf match-list-1 match-listl1) 

(setf match-list-2 match-list2) 

(dolist (matched-pair-1 match-list-1 nil) 

(when (match-equal-p (first matched-pair-1) 
(get-best-match (second (first (second matched-pair-1))) 
match-list-2)) 

(Print “best value x^) 

(print (float (first (first (first (second matched-pair-1)))))) 
(If (> (first (first (first (second matched-p3ir-1)))) 
*frar-threshold*) 

(setf best-match-list 

(append (list (list (first matched-pair-1) 

(second (first (second matched-pair-1))))) 
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best-match-1list))))) 
best-match-list)) 


(defmethod match-equal-p (matched-pair-1 matched-pair-2) 
(if (equal (first matched-pair-1) (first matched-pair-2) ) 
Е 

nil) 


(defmethod get-best-match (matched-pair-1 match-list) 

(when match-list 

(if (match-equal-p matched-pair-1 (first (first match-list))) 

(let () 

(when (second (first match-list)) 

(second (first (second (first match-list)))))) 

(get-best-match matched-pair-1 (rest match-list))))) 

(defmethod remove-matched-pair (target-matched-pair match-list) 

(if match-list 

(append (list (remove-matched-pair-subl 

target-matched-pair (first match-list))) 

(remove-matched-pair target-matched-pair (rest match-list))))) 
(defmethod remove-matched-pair-subl (target-matched-pair sub-listl) 
(append (list (first sub-list1)) 

(list (remove-matched-pair-sub2 target-matched-pair (second sub-list1))))) 
(defmethod remove-matched-pair-sub2 (target-matched-pair sub-list2) 
(Gf (first 50105-11562) 

(if (match-equal-p target-matched-pair (second (first sub-list2))) 
(rest sub-list2) 

(append (list (first sub-11st2)) 

(remove-matched-pair-sub2 target-matched-pair (rest sub-1list2)))))) 
(defmethod remove-main-match (matched-pair match-list) 

(if match-list 

(if (match-equal-p matched-pair (first (first match-list))) 

(rest match-list) 

(append (list (first match-list)) 

(remove-main-match matched-pair (rest match-list)))))) 
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